-- Logs begin at Thu 2022-05-05 14:10:53 UTC, end at Thu 2022-05-05 15:19:52 UTC. -- May 05 14:41:29.288899 dv-cinder-839426-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 05 14:41:29.296481 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 14:41:29 2022] *** May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: nodename: dv-cinder-839426-6-iscsi May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: machine: x86_64 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: clock source: unix May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: pcre jit disabled May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: detected number of CPU cores: 4 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: current working directory: / May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: detected binary path: /usr/bin/uwsgi-core May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: your processes number limit is 47680 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: your memory page size is 4096 bytes May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: detected max file descriptor number: 2048 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: lock engine: pthread robust mutexes May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: thunder lock: enabled May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 05 14:41:29.301666 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 14:41:29.346108 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: Python main interpreter initialized at 0x561f4acc39c0 May 05 14:41:29.346108 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: python threads support enabled May 05 14:41:29.346108 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: your server socket listen backlog is limited to 100 connections May 05 14:41:29.346108 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: your mercy for graceful operations on workers is 90 seconds May 05 14:41:29.346512 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: mapped 403077 bytes (393 KB) for 2 cores May 05 14:41:29.346591 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: *** Operational MODE: preforking *** May 05 14:41:29.346831 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: *** uWSGI is running in multiple interpreter mode *** May 05 14:41:29.346831 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: spawned uWSGI master process (pid: 79820) May 05 14:41:29.347041 dv-cinder-839426-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 05 14:41:29.353804 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: spawned uWSGI worker 1 (pid: 79832, cores: 1) May 05 14:41:29.353804 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: spawned uWSGI worker 2 (pid: 79833, cores: 1) May 05 14:41:29.353804 dv-cinder-839426-6-iscsi devstack@keystone.service[79820]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 14:41:35.136176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 14:41:35.136176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: from cryptography.utils import int_from_bytes May 05 14:41:35.136948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 14:41:35.136948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: from cryptography.utils import int_from_bytes May 05 14:41:35.137359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 14:41:35.137359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: from cryptography.utils import int_from_bytes May 05 14:41:35.137480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 14:41:35.137480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: from cryptography.utils import int_from_bytes May 05 14:41:35.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 14:41:35.186780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 14:41:35.186858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 14:41:35.186942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] command line args: [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 14:41:35.187178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 14:41:35.187275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 14:41:35.187339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] command line args: [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 14:41:35.187404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ================================================================================ {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 14:41:35.187469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 14:41:35.187638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] admin_token = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.187732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ================================================================================ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 14:41:35.187887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] config_dir = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.187968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] admin_token = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_dir = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] config_source = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] debug = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_source = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.188811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] debug = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.189966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.190276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.190484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.190802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_config_append = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.191031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.191228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.191335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_config_append = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.191650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_dir = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.191650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_dir = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_file = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.192982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.193758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.193968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.194968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.195331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.195525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.195719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.195896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.196826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.197972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198516 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] publish_errors = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] publish_errors = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.198960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.199910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] standard_threads = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] standard_threads = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.200989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_journal = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] use_journal = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_json = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.201921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] use_json = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_stderr = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] use_stderr = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_syslog = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] use_syslog = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 14:41:35.202888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.203961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.204975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.205968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.206968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.207892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.208994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.209983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.210894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.211909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.212948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.213920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.214979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.215910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.216958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.217189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.217359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.217614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.217884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.218051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.218258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.218490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.218658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.218852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.219047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.219242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.219436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.219667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.219836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.220032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.220261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.220429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.220656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.220875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.221079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.221248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.221480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.221658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.221827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.222861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.223978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.224858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.225839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.226516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.226646 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.226786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.226916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.227916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.228863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.229981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.230933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.231850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.232931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.external = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.233915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.password = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.external = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.token = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.234870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.password = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] auth.token = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.235930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.236992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.237848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.238927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.239823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.240467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.240606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.240737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.240874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.241973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.242800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.243949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.244898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.245854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.246981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.247928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.248989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.249981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.250905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.251988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.252921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.253921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.254917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.255049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.255179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.255310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.255310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.256209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.256448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.256595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.256728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.256868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.257972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.258878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.259943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.260877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.261905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.262971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.263920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.264985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.265961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.266885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.267949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.268871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.269973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.270892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.271897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.272960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.273978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] role.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] role.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.274912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.275969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.276903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.277995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.278927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.279980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.280920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.281869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.282952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.283949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.284876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.285888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.286873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.287957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288090 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.connection = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.288896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.289874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.290934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.291667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 14:41:35.292743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 14:41:35.301936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.302165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.302386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.303192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.303424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.303751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.311784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.312327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.340885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.341151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.341326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.341480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.395681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.396362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.448488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.448716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.449895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.450129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.516563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.516853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.517981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.518122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.518263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.518403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.541587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.541825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.541973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.542993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.543133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.543282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.543425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.543425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.554805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.555587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.569758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.570888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.571657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79832) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 14:41:35.588960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.589151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.589313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 14:41:35.589458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 14:41:35.589599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.589790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.589933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 14:41:35.590073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 14:41:35.590225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.590367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.590506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.590644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.590783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.590930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.591071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.591209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.602295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.602571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.602719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.602880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.603024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.603164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.603304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.603451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.611182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.611408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.614462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.614669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.614762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.615042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.615667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.616926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.617908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.618001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.618170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.618437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.644433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.646156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.646447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.651753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.652031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.652304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.659623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.659902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.662565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.664379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.664656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.665059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.665342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.665622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.665926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.666195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.666462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.666723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.666985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.669936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.670440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.670597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.678577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.678858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.683501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.683790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.684076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.684355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.684628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.684901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.685169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.685435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.686200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.686475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.691216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.694859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.695147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.700070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.703622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.704287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.704563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.707344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.707638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.707920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.708200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.708472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.708822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.709215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.712848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.713140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.718116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.721692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.725980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.726277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.726561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.726844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.727119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.727397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.728085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.728458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.728725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.728985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.736839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.738560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.738851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.742603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.742878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.743179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.743454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.743723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.747024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.747397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.747666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.747932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.755882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.757164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.757440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.757601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.757774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.757928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.758069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.758267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.758536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.758815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.760894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.761171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.761468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.761770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.762047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.776185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.776464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.776742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.777019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.777281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.777429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.777580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.777838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.780570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.783902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.785478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.787258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.787533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.787824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.795178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.796042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.796773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.799334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.799989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.800275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.800560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.800831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.803401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.805003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.806664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.806948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.807232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.810585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.810876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.811159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.814911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.816510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.819978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.820252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.820408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.820549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.820685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.820821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.820968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.821106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.821252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.821391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.821565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.821861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.822133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.822394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.822673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.822928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.823184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.823447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.830410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.830707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.830988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.839095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79832) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 14:41:35.839383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.839632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.839914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.840192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.840461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.840731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.841009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.841276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.841542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.841849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.842108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.842374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.842644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79832) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 14:41:35.862076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4acc39c0 pid: 79833 (default app) May 05 14:41:35.866007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad349-306d-4184-aab6-60f074e9e095 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:35.866285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad349-306d-4184-aab6-60f074e9e095 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:35.866560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad349-306d-4184-aab6-60f074e9e095 None None] PATH_INFO: `/v3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:35.872467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu May 5 14:41:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:35.882727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4acc39c0 pid: 79832 (default app) May 05 14:41:44.014580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:44.015146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:44.015146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:44.016434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:41:44.024148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:44.024549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:44.024781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:44.055068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG oslo_db.sqlalchemy.engines [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 14:41:44.237360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG passlib.handlers.bcrypt [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79832) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 14:41:44.237820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG passlib.handlers.bcrypt [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79832) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 14:41:44.293662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:44.295247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:44.418895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 14:41:44.602166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:44.636512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG oslo_db.sqlalchemy.engines [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 14:41:44.763857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7615c24-cca4-4708-957e-9041361a94f7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:44.768025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:44.768681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:44.768962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:44.769234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:44.778239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:44.831476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 14:41:44.831811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f728-e9e6-40ee-a0af-4e3f3f205317 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:44.843664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 5 14:41:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 14:41:44.850277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:44.864337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc392e4f-c12a-47dc-aed6-7e242fd9228d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:44.868811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:44.869952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:44.870239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:44.870525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] PATH_INFO: `/v3/projects/dff5ce0253c84661be86a23d6b0b873d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:44.872037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] RBAC: Authorizing `identity:get_project(project_id=dff5ce0253c84661be86a23d6b0b873d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:44.923199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING keystone.common.rbac_enforcer.enforcer [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 14:41:44.923539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499411b7-bcd7-4b17-b818-4c65e6cba52c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:44.928079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu May 5 14:41:44 2022] GET /identity/v3/projects/dff5ce0253c84661be86a23d6b0b873d => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:47.191693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b150-53b0-4de5-ac15-6f59ed9cdc99 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:47.192219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b150-53b0-4de5-ac15-6f59ed9cdc99 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:47.192219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b150-53b0-4de5-ac15-6f59ed9cdc99 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:47.197483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:47.203549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:47.204064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:47.204184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:47.225592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:47.227120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:47.234914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 05 14:41:47.258712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52b150-53b0-4de5-ac15-6f59ed9cdc99 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:47.270655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52b150-53b0-4de5-ac15-6f59ed9cdc99 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:47.274829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:47.275461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:47.275741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:47.276016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:47.283478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:47.285234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30903e8-b91d-46fb-9894-609b42516b16 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:47.294419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 5 14:41:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 14:41:47.299990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:47.309839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209e04-5f15-41e3-8dcc-6af4787fcab7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:47.314432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:47.315288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:47.315565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:47.315835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:47.317206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:47.319744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115c11-08fd-4542-a790-5ad68e88a103 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:47.321299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu May 5 14:41:47 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:49.635318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4498-96ab-4763-a5bd-704610c82f2b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:49.635833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4498-96ab-4763-a5bd-704610c82f2b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:49.635908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4498-96ab-4763-a5bd-704610c82f2b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:49.637359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:49.642534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:49.642950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:49.643093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:49.685882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8d66-b87e-4789-95a0-af8a66a7ddd7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:49.686174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8d66-b87e-4789-95a0-af8a66a7ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:49.686352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8d66-b87e-4789-95a0-af8a66a7ddd7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:49.687725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:41:49.694355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:49.694671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:49.694914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:49.737090 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG passlib.handlers.bcrypt [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79833) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 14:41:49.737582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG passlib.handlers.bcrypt [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79833) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 14:41:49.769282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:49.770491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:49.788139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:49.789757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:49.848578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:49.872509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:49.901680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:41:49.920114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:49.980065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35202f4-0bf1-4fbe-8d32-e65495ff4c50 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.016653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.017857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.018345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.018848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.028009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c87dd7-9858-4ef6-bef5-e11d90ca0fd1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.030743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:41:50.042072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:41:50.043070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:41:50.043876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:41:50.050738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.065208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.066128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.066412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.066680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.134284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.135802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.147160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c7a7-7542-4f63-ba26-2e66525db181 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.179383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.180045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.180330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.180608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.181358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:50.181691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.183080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.195422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:50.200994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.232781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 14:41:50.238252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.300417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34068-0166-4044-9431-0ac4676dfa62 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.347601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.348487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.348766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.349850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.350891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.352354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.354016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:50.359870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.440588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d50379-7e19-492e-948f-c23af1d67019 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.456559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c2d3-ff58-4243-9ea6-34e37a1c18f0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.473198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.474061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.474344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.474618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.489473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.490284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.490560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.490835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.492014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.493134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.493442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.494623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.495064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:50.500608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:41:50.515577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:41:50.516561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:41:50.517362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:41:50.517362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:41:50.517362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:41:50.517362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:41:50.517362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:41:50.523180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:50.594815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92bbde-7ba6-46f0-ae78-a843174872d1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.620323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5c8c-ea3b-4970-bab1-06770c0af7fe None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:50.626267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.626919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.627213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.627489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.628313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.domain.id=default, user.id=9ab29a96b7f245e482c4b00b767803a9) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:50.628625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.630575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9b8e-f5f9-4f84-a7fd-596055b7c35b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.637479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/role_assignments?user.id=9ab29a96b7f245e482c4b00b767803a9&scope.domain.id=default&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:50.654818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:50.655502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:50.655784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:50.656060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:50.656807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:50.657115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:50.658580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2b2d3-ee53-4795-8701-aa428ebc8284 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:50.678456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:53.129184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab544d-6e82-48f5-964d-fd726b0db625 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.130288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab544d-6e82-48f5-964d-fd726b0db625 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.130853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab544d-6e82-48f5-964d-fd726b0db625 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.132733 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:53.138177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.139122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.139609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.170894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:53.172473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:53.250844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:41:53.278288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab544d-6e82-48f5-964d-fd726b0db625 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:53.395372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab544d-6e82-48f5-964d-fd726b0db625 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:53.437239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:53.438070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.438609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.438893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.454800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-6a24fc46-6763-46bf-a2bd-e33fec244914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:41:53.462492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:41:53.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:41:53.464536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 12/24] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:41:53.470013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:53.565572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea322-5d23-404b-88d2-8ff4eba0930b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.566265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea322-5d23-404b-88d2-8ff4eba0930b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.566753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea322-5d23-404b-88d2-8ff4eba0930b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.573776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 13/25] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:41:53.575260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.575775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.576267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.600651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60086b-3865-4bb4-987d-10a4c7c6a193 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:53.610712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:53.612162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:53.645266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:53.647261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.647512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.647791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.648557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:53.648866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:53.650315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:53.664481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:53.670524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:53.704330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:53.758601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:53.788856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a9c60-d0f5-4f3f-8f44-e24504debebb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:53.829508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:53.830419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:53.830701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:53.830973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:53.833695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:53.835160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:53.838007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:41:53 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:53.847345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:53.976779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58651c47-a17d-47f2-b78b-c0dfe4324681 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.059289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6513a-8550-43f8-9c75-ce4cb1ed4353 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.068308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.069298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.069577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.069939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.086936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.088429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.102155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.102961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.103261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.103521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.104712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.106322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6240-ce7f-4083-b218-64001162b7f3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.108141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 15/29] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:54.109098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65555-0dde-4e97-88f2-fd078bafcfc6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.109385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65555-0dde-4e97-88f2-fd078bafcfc6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.109681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65555-0dde-4e97-88f2-fd078bafcfc6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.111087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:54.114318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65555-0dde-4e97-88f2-fd078bafcfc6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-0ad13173-1009-4a2c-8be1-8f358a921104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:41:54.132980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:41:54.134174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:41:54.134971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:41:54.134971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:41:54.134971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:41:54.134971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:41:54.143307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 15/31] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:41:54.144860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.146460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.147103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.177586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:54.183748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:54.312779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65555-0dde-4e97-88f2-fd078bafcfc6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.325924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:54.326583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:54.386216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.387105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.387387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.387673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] PATH_INFO: `/v3/domains/default/users/9ab29a96b7f245e482c4b00b767803a9/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.393127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9ab29a96b7f245e482c4b00b767803a9, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.394702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395996f7-8e02-4370-82e7-62b57755203d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.463332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ad5d-a4d5-4da2-a90a-3ed016787786 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.498649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.499548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.499980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.500402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.501300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:54.501797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.503315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.521708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 17/33] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:54.522772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:54.538498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1361 bytes} [Thu May 5 14:41:54 2022] PUT /identity/v3/domains/default/users/9ab29a96b7f245e482c4b00b767803a9/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:41:54.540856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8212c0-54ba-4632-a4c6-baaf08f74ac2 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.541399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8212c0-54ba-4632-a4c6-baaf08f74ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.541920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8212c0-54ba-4632-a4c6-baaf08f74ac2 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.551502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 18/35] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:54.553431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8212c0-54ba-4632-a4c6-baaf08f74ac2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:54.657111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4b63-b514-49db-8491-eb35939daae1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.668349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8212c0-54ba-4632-a4c6-baaf08f74ac2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:54.710978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.711991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.712429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.712863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.714248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.717097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94fb61-653f-4065-b4a8-fb45848976db None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.745894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:54.746744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.747127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.747501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.748332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:54.750086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73329-e74c-44c2-bce6-6f1fea7d372b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:54.785716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/projects => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:41:54.785716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2c9-b0f6-4b75-9cc9-54bb60a3f7cd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.785716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2c9-b0f6-4b75-9cc9-54bb60a3f7cd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.785716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2c9-b0f6-4b75-9cc9-54bb60a3f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.801300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e3bbf2c9-b0f6-4b75-9cc9-54bb60a3f7cd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:54.803772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e3bbf2c9-b0f6-4b75-9cc9-54bb60a3f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:54.883527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/roles => generated 219 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:41:54.885302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65193b4-8d38-49f3-b084-1872dcfe3f9b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.885742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:54.885955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65193b4-8d38-49f3-b084-1872dcfe3f9b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.886142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65193b4-8d38-49f3-b084-1872dcfe3f9b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.887626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:54.893754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:54.894089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:54.894333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:54.917764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65193b4-8d38-49f3-b084-1872dcfe3f9b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:54.927693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:54.929023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:55.045496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65193b4-8d38-49f3-b084-1872dcfe3f9b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:55.080441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:55.086029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:55.087151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.087682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.088149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.089171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:55.091076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d2cdb-0310-4a44-abd5-9c60e6a24b6d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:55.112460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 5 14:41:54 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:41:55.123181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:55.160650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48730-b5af-4339-9eb2-3720ea1c0dcb None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.161167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48730-b5af-4339-9eb2-3720ea1c0dcb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.162130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48730-b5af-4339-9eb2-3720ea1c0dcb None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.164963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 21/42] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:41:55.171063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.171611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.172071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.200628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:55.202988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:55.267112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe9e2-7b4d-43fa-a65c-7890681f2913 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:55.300757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 22/43] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:41:55.310303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:55.311485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.311996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.312476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.314440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:55.316659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:55.318770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:55.325191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:55.330054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:55.441219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550fd28-e1fc-47d8-8180-f931d5e28ea5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:55.441787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfdeb5-639a-41b3-b41a-b6f5be22f143 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:55.478798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:55.479463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.479749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.479853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:55.480028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.480452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:55.480742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:55.480834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:55.481019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:55.481796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:55.482214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca85b-21e7-44e6-9cb1-dd1a1e2de360 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:55.483216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125647-7603-47ac-8499-124df360c8f5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:55.496741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 5 14:41:55 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:41:55.508970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:41:55 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:41:57.171485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48110a-c016-493a-9794-a5f88469d66e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.172034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48110a-c016-493a-9794-a5f88469d66e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.172034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48110a-c016-493a-9794-a5f88469d66e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.173403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:41:57.179262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.179671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.179823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.196361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:57.197528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:57.261844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:41:57.284947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48110a-c016-493a-9794-a5f88469d66e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.382509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48110a-c016-493a-9794-a5f88469d66e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:57.414586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:57.415370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.415652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.415924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.426630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:41:57.436060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:41:57.437047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:41:57.437842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 25/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:41:57.443458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.538201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a624-5f03-4a5f-b471-da72036445d0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:57.571010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:57.571676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.571963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.572523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.573283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:57.573595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:57.575006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:57.582882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 25/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:57.588464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.686764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a102f20-8fb6-4fc7-aa5b-28c9ca48f2e2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:57.719281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:57.720153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.720439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.720718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.721925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:57.723378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2703-a9fa-4a3f-8b7a-9bab5c9282ac None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:57.725046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 26/51] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:57.730494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.820459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe0a-1f89-45be-9f21-803fb613bea6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.820743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe0a-1f89-45be-9f21-803fb613bea6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.821029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe0a-1f89-45be-9f21-803fb613bea6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.822429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 27/52] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:41:57.827535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.827824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.828105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.836618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d5c-4d96-49da-bd88-23dbb1b4f9c6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:57.845520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:41:57.846748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:41:57.869111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:57.869939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:57.870225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:57.870508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:57.871682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:57.873119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:57.874757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:41:57.881134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.911874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 28/54] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:41:57.934885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:57.975952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e724068-c89a-467b-9625-ced24ca04b91 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:58.008237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:58.008933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:58.009219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:58.009498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:58.010357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.domain.id=default, user.id=9ab29a96b7f245e482c4b00b767803a9) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:41:58.010672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:58.012114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:58.017999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/role_assignments?user.id=9ab29a96b7f245e482c4b00b767803a9&scope.domain.id=default&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:58.029973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b2d2e-71fe-4432-b4f3-168a23d34da5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:58.066068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:58.066873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:58.067160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:58.068013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:58.069275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:58.070774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f2d7a-88f1-4d34-98a1-deef172d3b37 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:58.072462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:41:58.078418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:41:58.183244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9867-6e87-4f6b-abfd-6b5cf29e132a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:41:58.218672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:41:58.219343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:41:58.219639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:41:58.219911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:41:58.220634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:41:58.222133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef71c70-a925-4ced-b724-1f745e002c96 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:41:58.247365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 5 14:41:58 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:00.533024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaade6-419f-479f-9091-47367f1c19c8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:00.533556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaade6-419f-479f-9091-47367f1c19c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:00.533556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaade6-419f-479f-9091-47367f1c19c8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:00.534981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:00.541003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:00.541396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:00.541565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:00.557501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:00.558709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:00.620373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:00.643943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaade6-419f-479f-9091-47367f1c19c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:00.739104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaade6-419f-479f-9091-47367f1c19c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:00.771009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:00.771777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:00.772057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:00.772330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:00.773497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:00.774957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3410f98-a93b-42d0-b275-a5dfc863c26f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:00.776545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:00.782136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:00.875268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b57f3b-c3a1-44e5-8479-ceceb4c470d7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:00.907515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:00.908174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:00.908463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:00.908743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:00.909440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:00.910923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8dab4-ea44-470b-ad10-b1fbc2fa8436 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:00.934924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:00 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:04.319531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7948d-d283-406e-90db-8b9ff14774c8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.320630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7948d-d283-406e-90db-8b9ff14774c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.321118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7948d-d283-406e-90db-8b9ff14774c8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.323172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:04.329226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e948-384e-4209-bfe3-324ad202ce70 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.330222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e948-384e-4209-bfe3-324ad202ce70 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.330728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e948-384e-4209-bfe3-324ad202ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.358789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1f35e948-384e-4209-bfe3-324ad202ce70 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:04.360337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1f35e948-384e-4209-bfe3-324ad202ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:04.459545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:04.495442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7948d-d283-406e-90db-8b9ff14774c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:04.537769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815663b-1158-45d1-9694-5c272457cfad None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.538081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815663b-1158-45d1-9694-5c272457cfad None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.538339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815663b-1158-45d1-9694-5c272457cfad None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.539974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 32/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:04.544751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086ba7-432c-4cc5-9396-92ac4e96610e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.545040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086ba7-432c-4cc5-9396-92ac4e96610e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.545329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086ba7-432c-4cc5-9396-92ac4e96610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.574747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4e086ba7-432c-4cc5-9396-92ac4e96610e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:04.575877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4e086ba7-432c-4cc5-9396-92ac4e96610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:04.614962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7948d-d283-406e-90db-8b9ff14774c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:04.665305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:04.666397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.666826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.667288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.678676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dc5d736d-f22c-4bf9-b2b2-470c6ea32155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:04.686680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:04.687535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:04.688379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:04.691125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 33/65] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:04.692785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67cac-6583-45f1-ae2f-b2dbd9d09c70 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.693245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67cac-6583-45f1-ae2f-b2dbd9d09c70 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.693709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67cac-6583-45f1-ae2f-b2dbd9d09c70 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.695393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 34/66] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:04.696808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:04.697063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67cac-6583-45f1-ae2f-b2dbd9d09c70 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:04.703474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.703845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.704202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.729519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:04.731043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:04.821200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67cac-6583-45f1-ae2f-b2dbd9d09c70 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:04.824463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:04.826003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:04.861032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:04.862236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:04.862652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:04.862948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:04.863722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:04.864109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:04.866158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:04.881979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:04.883256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:04.956330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8abe2c-4b54-408e-9531-b2cf84debe4a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:04.984055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97aa89-4dd2-406b-9b26-ed0f511186ab None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.002231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.003037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.003322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.003602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.014778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:05.019107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.020163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.021185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.021708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:05.023044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:05.023902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:05.024664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:05.025289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.034656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bab96ed8-943b-4f59-909c-1f43a307553e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:05.043286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:05.044340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:05.045368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:05.047210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a46df-9518-4129-9513-efaeaf62185c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.047210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a46df-9518-4129-9513-efaeaf62185c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.047210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a46df-9518-4129-9513-efaeaf62185c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.048523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 37/72] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:05.049691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a46df-9518-4129-9513-efaeaf62185c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.129115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9f14-4542-4129-be22-254a2557b37d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.146681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a46df-9518-4129-9513-efaeaf62185c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.160638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.161674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.161961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.162235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.174764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.176223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b4853-584a-462a-a56f-060f089f6c93 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.178611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.178801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.179472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.179829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441845d-18e0-461b-b48d-8c5b5b36011e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.179927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.180107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.180198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441845d-18e0-461b-b48d-8c5b5b36011e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.180384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441845d-18e0-461b-b48d-8c5b5b36011e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.180858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:05.181169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.181803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 37/74] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:05.182346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441845d-18e0-461b-b48d-8c5b5b36011e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.182689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c2998-7225-48be-bc54-fd1bde0be2a8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.191569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.193526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.193844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.194125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.209767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:05.210966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:05.273728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 39/76] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:05.274626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.280958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441845d-18e0-461b-b48d-8c5b5b36011e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.314512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.315172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.315457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.315729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.316463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:05.316766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.318246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ef573-0147-490b-85a5-7aeef185fb6e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.325758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 38/77] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.326920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.327354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.327767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.343950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:05.345117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:05.369703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d929d-7646-4c8b-ab20-8f1227fbec12 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.402251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.402830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.403116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.403395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.407380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 39/78] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:05.408286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.472281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.473844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.502128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67717c70-78b8-4f61-8a75-e474a14393ff None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.534835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.535702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.536012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.536291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.537458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.538911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.540522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.541275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.566840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:05.568358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.633807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc0a38-39ee-4422-a7dc-145f01c12848 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.661106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c043d-d32e-4120-97a2-05a777c3ee5b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.665212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.666022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.666300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.666568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.667716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.669130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.670749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.672618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.694970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.695833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.696112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.696381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.697550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.699004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.700632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.701349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.768372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c34567-261c-4ea4-9a11-bd962f040b19 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.793866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5d91-03d6-4c8a-b679-65511fb49117 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.799557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.800338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.800617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.800893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.810960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:05.819422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:05.820305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:05.826277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.827113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.827513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.827794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.828069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.890594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.892051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.918167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baf9-6eb0-4c20-97e9-61c4034e1849 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:05.950355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:05.951203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:05.951489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:05.951767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:05.952939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:05.954412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:05.956078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:05.956828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:05.989541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 42/85] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:05.990573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.056288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b1e08-d465-495f-bbfb-5c054f40e546 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.081852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63efcb-0c75-41d8-9dac-2011d7cebe6d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.092386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.093061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.093352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.093635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.094378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.095812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.115398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.116040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.116321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.116599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.117926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 44/86] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:05 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:06.118763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.194270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.195717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.235005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664483-e5b1-4bd9-8baf-0f7940a6b5cc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.272100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.272787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.273068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.273340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.274139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:06.274449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.275847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.284691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 45/87] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.285558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.299663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:06.300843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.390328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f19d6-d6d9-4d10-8f67-22b836bfa8ad None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.401438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095312-f9e1-4833-8d52-0a7eef0836f7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.429880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.430552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.430894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.431169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.432521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:06.432521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.435677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.437067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.437962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.438242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.438782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.439981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.441427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.442797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.443907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 44/90] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.444701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.444804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.569107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c829e-96bf-4c42-b7bd-c99b5265e18e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.583309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9766-e145-450d-a53d-10bf4acf69c7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.608622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.609524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.609861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.610142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.611968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.613782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.617187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 47/91] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.618045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.633112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.634262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.634542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.634815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.636189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.637669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.639478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 45/92] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.640264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.745728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842383-4ebe-40c2-a686-16a23e30f0fb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.760824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080715-d100-46f2-abcb-0a3fce6d314b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:06.799260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.799923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.800209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.800490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.802221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:06.802969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:06.803254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:06.803534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:06.804368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=9ab29a96b7f245e482c4b00b767803a9) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:06.804683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.806171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:06.823763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 48/93] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/role_assignments?user.id=9ab29a96b7f245e482c4b00b767803a9&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:06.825988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:06.909609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:06.912097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:07.025975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 46/94] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:07.031031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:07.053125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963beb71-02f5-4d8b-89c7-372e35b639de None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:07.089749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:07.090414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:07.090696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:07.090971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:07.091807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:07.092123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:07.093568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:07.100082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 49/95] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:06 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:07.196948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752470-b4fc-4c9e-8867-3add6fe8e1b4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:07.243597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:07.244525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:07.244809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:07.245086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] PATH_INFO: `/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:07.250530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] RBAC: Authorizing `identity:get_project(project_id=576b6c139b5a47dc9c6420d2d40abe4f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:07.252054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec400cd-58dc-48b0-aca5-14b95b3506cc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:07.253882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:07 2022] GET /identity/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:07.260369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:07.389444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ef5f-c050-441c-af5b-479b81dbf5c3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:07.426354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:07.427677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:07.427961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:07.428243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:07.429086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=576b6c139b5a47dc9c6420d2d40abe4f, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:07.429398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:07.430897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f8b5e-6442-4379-abae-55724f693241 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:07.436866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:07 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=576b6c139b5a47dc9c6420d2d40abe4f&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:09.378581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cbd8-70c7-4803-9f1f-abce7e521340 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.379269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cbd8-70c7-4803-9f1f-abce7e521340 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.379269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cbd8-70c7-4803-9f1f-abce7e521340 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.381291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:09.387052 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52acda-514c-4917-a913-971c02aeb897 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.387600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52acda-514c-4917-a913-971c02aeb897 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.387600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52acda-514c-4917-a913-971c02aeb897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.407831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6c52acda-514c-4917-a913-971c02aeb897 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:09.409010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6c52acda-514c-4917-a913-971c02aeb897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:09.488368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:09.510644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9607826-0eb3-4846-994d-351ed1f40a78 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.510644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9607826-0eb3-4846-994d-351ed1f40a78 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.510644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9607826-0eb3-4846-994d-351ed1f40a78 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.510644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 49/100] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:09.518440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.518440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.518963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9607826-0eb3-4846-994d-351ed1f40a78 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:09.519142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.546672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:09.547851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:09.625236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9607826-0eb3-4846-994d-351ed1f40a78 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:09.656155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:09.667679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:09.668623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.669013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.669392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.686193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:09.700473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:09.701428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:09.702260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 50/102] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:09.709225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:09.712401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:09.813881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090490-1b53-4861-b873-82a8cecc456c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:09.850412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:09.851384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:09.851671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:09.851947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:09.853268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:09.855572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:09.857388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 51/103] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:09.863045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:09.985440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb567-ccdf-4976-a578-a6dba22c5c57 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:09.991590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a79b8-9fb8-40e3-a4ab-73fa2aa852b3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.021327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.022360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.022867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.023368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.024300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.025966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.058224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 52/104] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:42:09 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:10.063307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.064534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.065030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.065516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.066495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:10.067154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.068793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd29d5-fdd5-4767-b910-95fef9ddb5a6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.078701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 53/105] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:10.086875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.163717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a8d5-f4e4-4ae4-9b2d-4597e761baf5 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.164372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a8d5-f4e4-4ae4-9b2d-4597e761baf5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.164866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a8d5-f4e4-4ae4-9b2d-4597e761baf5 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.166813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 54/106] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:10.172690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.173258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.173806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.209609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:10.210849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:10.262720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06232bb-cfcf-45c1-bd65-0f4e9fc19eb1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.332939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.336024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.337816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.338360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] PATH_INFO: `/v3/users/fdc9491644a74f6a9a8b6b86cc454fba` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.372625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc9491644a74f6a9a8b6b86cc454fba)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.376052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5af4-ed08-4a72-99e4-76cc24b6d3f4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.378172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 53/107] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/users/fdc9491644a74f6a9a8b6b86cc454fba => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:10.379199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:10.380843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99551-93a5-47db-b9d7-9ac9895f779b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.381690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99551-93a5-47db-b9d7-9ac9895f779b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.382200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99551-93a5-47db-b9d7-9ac9895f779b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.384635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.385114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 54/109] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:10.390720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.391275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.391758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.412030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:10.412529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:10.493402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:10.494311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.503170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8865-b8a7-4da9-9666-47bfa0dbcdf2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.540751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.541337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.541625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.541927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.596033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf40073-b0f6-4b7b-9dbe-354ed0c83062 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.627905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.629390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f2ff1-b550-4a32-a1db-f67360e91a15 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.630893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.631893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.632350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.632817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.643660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:10.652302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:10.653218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:10.653993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:10.656057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:10.657106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.730184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:10.731339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3c4d-9311-4eca-8715-971b0b52d650 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.731639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3c4d-9311-4eca-8715-971b0b52d650 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.731921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3c4d-9311-4eca-8715-971b0b52d650 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.741813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 57/113] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:10.742711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3c4d-9311-4eca-8715-971b0b52d650 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.761757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6be44-83f8-453e-800c-6d65ba42e8da None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.795913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.796970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.797420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.797917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.809033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:10.817269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:10.818377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:10.819260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:10.821122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:10.822105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:10.857752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3c4d-9311-4eca-8715-971b0b52d650 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.893342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.894391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.894895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.895514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.896544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:10.897059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.898721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c3c0d-4406-4022-87ad-394e1e8fccc7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.907381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 58/115] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:10.909006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.909516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.910020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.927588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:10.929310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:10.935059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875029-17cf-477d-9136-217c84cbd351 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:10.981523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:10.982688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:10.983157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:10.983540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:10.984756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:10.986944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:10.989735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 58/116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:10.990521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.011833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 59/117] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:11.017947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.101710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30dae-6c82-4895-acc7-9e23858981ba None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.135262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.135939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.136230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.136534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.136854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715512-21a7-4d22-ad0e-7ee660dbe921 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.137293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:11.137604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.139037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.148154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 59/118] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.148762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.175593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.177078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.177538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.178069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.179646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.181095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.182794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 60/119] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.183556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.251248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484b6-4aed-4a9c-a3e4-b8a70042251f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.283894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329305c-8d40-4555-a778-ae4b1e2ff0f5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.286177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.286916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.287207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.287493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.288327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=fdc9491644a74f6a9a8b6b86cc454fba) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:11.288644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.290112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a299-4a89-4b70-bc11-0393cadb4c7a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.297685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/role_assignments?user.id=fdc9491644a74f6a9a8b6b86cc454fba&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.298826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d249c-f25f-48d5-abe1-f70cdd2b575f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.299116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d249c-f25f-48d5-abe1-f70cdd2b575f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.299395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d249c-f25f-48d5-abe1-f70cdd2b575f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.306046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 61/121] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:11.306046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d249c-f25f-48d5-abe1-f70cdd2b575f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.336774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.338613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.339415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.339923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.356182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:11.367351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:11.368273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:11.369040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:11.371321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:11.371972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.453189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d249c-f25f-48d5-abe1-f70cdd2b575f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.487857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440dd36-39af-4d40-873d-896967ea8319 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.497745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.498270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.498760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.499226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.500920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.502443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d9ba1-095e-4b45-aff0-4965d299152c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.504982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.506393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.506687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.506978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.532680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.534302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.534815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.535139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:11.535514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.536521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:11.537275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.540135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.542132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 62/124] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.543104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.629783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 63/125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:11.629783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.671110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1cc1-427f-45a2-8a23-77dca1c9af2d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.705017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.706090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.706574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.707087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.708203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:11.708713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.710307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.718480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 63/126] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.719494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.746756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d43a-84e7-4d40-9259-5599bca12f89 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.781971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.782988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.783097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.783369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.784555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.786586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.793227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 64/127] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:11.793227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.852496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd871cbf-58b7-4d77-b8bf-bf5839f9f972 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.885317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.886190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.886475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.886751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/9ab29a96b7f245e482c4b00b767803a9/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:11.888718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, user_id=9ab29a96b7f245e482c4b00b767803a9, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:11.890203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:11.905591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d369f7-5a8d-4c41-8dd3-83c0e9f62d46 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:11.913751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 64/128] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:11 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/9ab29a96b7f245e482c4b00b767803a9/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:11.913751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:11.980201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:11.981008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:11.981308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:11.981572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.005704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:12.019239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:12.020248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:12.021053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:12.021904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 65/129] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:12.029810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.115557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dfa9f-6576-4846-ac44-565e0f91dee5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.166812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.167612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.167892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.168161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.171864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.173304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.175189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 65/130] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:11 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:12.175950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.194079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b67e6-d697-48a9-ad18-9cb4f43eea11 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.237409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.238492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.239820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/37a535f74d794b958f30b4b934376917/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.242621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, user_id=37a535f74d794b958f30b4b934376917, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.244854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.267653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 66/131] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:12 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/37a535f74d794b958f30b4b934376917/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:12.268502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.318950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca430-cdf2-440b-adf3-7a17d8b097fc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.383890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.384568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.384853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.385132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.385967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:12.386285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.387675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.412156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 66/132] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:12.433694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.443644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b96b5-3d5b-4bf0-b0ef-6c663714a683 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.482087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.482965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.483248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.483526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.484782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.486285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.488022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 67/133] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:12 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:12.494331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.586170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11442e-6b36-4e54-8ec7-59f941d625ca None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.598003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378004-b0e7-41c6-ae97-fab962703193 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.621180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.622098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.622385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.622667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.623913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.625398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.627324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 67/134] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:12 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:12.635837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.640876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.641851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.642139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.642418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/37a535f74d794b958f30b4b934376917/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.644770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, user_id=37a535f74d794b958f30b4b934376917, role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.646390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.669761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:12 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/37a535f74d794b958f30b4b934376917/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:42:12.761915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed768f3-aa20-4961-a48a-f8eea7c3fc7f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.797137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:12.798049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.798335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.798613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] PATH_INFO: `/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.799881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] RBAC: Authorizing `identity:get_project(project_id=576b6c139b5a47dc9c6420d2d40abe4f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:12.801455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed6e37-81ea-402b-ab14-c2b00f6293cc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:12.803451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 68/136] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:12 2022] GET /identity/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:12.809168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:12.923883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90241e-d938-420f-9092-b00c70343ab9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:12.946500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea80ff-3197-4f27-8867-049d0566de5c None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.946824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea80ff-3197-4f27-8867-049d0566de5c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.947055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea80ff-3197-4f27-8867-049d0566de5c None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.948421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 69/137] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:12.959090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:12.959381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:12.959642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:12.984930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:12.986169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:13.000373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:13.001337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:13.001624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:13.001922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] PATH_INFO: `/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f/users/37a535f74d794b958f30b4b934376917/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:13.007332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=576b6c139b5a47dc9c6420d2d40abe4f, user_id=37a535f74d794b958f30b4b934376917, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:13.011490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:13.030117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 69/138] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:12 2022] PUT /identity/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f/users/37a535f74d794b958f30b4b934376917/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:13.097354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 70/139] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:13.144627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:13.269054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6e17b-cfd3-41b5-ae25-884dee613b49 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:13.310960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:13.311779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:13.312063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:13.312340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:13.314440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:13.315947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9bfd-4baf-4cc8-a948-2dff4827634a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:13.317915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 70/140] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:13.323422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:13.429697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706ec08-b9ca-4fd7-9cc3-1da01fd44ae8 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:13.477683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:13.477683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:13.477683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:13.477683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:13.478074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:13.478074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107998-fd88-4a4b-a484-dc88ee35c5ab None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:13.513427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 71/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:13 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:14.171695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ef0-56bb-448f-ac83-006e8c14076f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:14.172193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ef0-56bb-448f-ac83-006e8c14076f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:14.172291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ef0-56bb-448f-ac83-006e8c14076f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:14.173784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 71/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:14.181000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc43e-955b-41fa-adf5-53949319946e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:14.181891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc43e-955b-41fa-adf5-53949319946e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:14.182388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc43e-955b-41fa-adf5-53949319946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:14.200420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-582cc43e-955b-41fa-adf5-53949319946e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:14.201916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-582cc43e-955b-41fa-adf5-53949319946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:14.270613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 72/143] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:14.292909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740ef0-56bb-448f-ac83-006e8c14076f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:14.430856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740ef0-56bb-448f-ac83-006e8c14076f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:14.479252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:14.479252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:14.479252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:14.479252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:14.494940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:14.502764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:14.503695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:14.504521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 72/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:14.511943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc43e-955b-41fa-adf5-53949319946e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:14.653083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc43e-955b-41fa-adf5-53949319946e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:14.689349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:14.689999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:14.690287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:14.690570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:14.691354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:14.691673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:14.693203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:14.706298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 73/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:14.712357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:14.842502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9737-c157-4d8e-b992-6e18130c4153 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:14.883002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:14.883887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:14.884167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:14.884441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] PATH_INFO: `/v3/users/fdc9491644a74f6a9a8b6b86cc454fba` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:14.885767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] RBAC: Authorizing `identity:get_user(user_id=fdc9491644a74f6a9a8b6b86cc454fba)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:14.887253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:14.889394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 73/146] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:14 2022] GET /identity/v3/users/fdc9491644a74f6a9a8b6b86cc454fba => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:14.896638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:15.036209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b5cd2-dcd3-44a3-8f11-a8763bc7d4e4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:15.075914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:15.077116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.077593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.078188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.079568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:15.081205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b51a-19b9-4c47-856c-39ffd2e0dbc4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:15.083192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:14 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:15.089401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:15.213793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765f387-7a1c-4d5f-9903-7b8b9187fedf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:15.252677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:15.253924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.254473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.254951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/fdc9491644a74f6a9a8b6b86cc454fba/roles/d2c8e940ae324570852a3cbfabc8e798` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.258168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, user_id=fdc9491644a74f6a9a8b6b86cc454fba, role_id=d2c8e940ae324570852a3cbfabc8e798)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:15.259847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:15.274732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ac36e-6936-4311-bb7b-95d7ad0dbe27 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.275991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ac36e-6936-4311-bb7b-95d7ad0dbe27 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.276412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ac36e-6936-4311-bb7b-95d7ad0dbe27 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.277987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 75/148] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:15.283657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.284123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.284542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.300215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 74/149] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:15 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/users/fdc9491644a74f6a9a8b6b86cc454fba/roles/d2c8e940ae324570852a3cbfabc8e798 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:42:15.310834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:15.312264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:15.392277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:15.424336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:15.559985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dc219-ac8b-4fc6-a78d-84637947b187 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:15.596439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:15.597231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.597512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.597822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.609039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:15.616817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:15.617933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:15.618848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 75/151] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:15.625013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:15.754343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c9a8-7d28-4d03-b4eb-c549532b6e73 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:15.793133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:15.794216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.794649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.795089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.795973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:15.796442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:15.797977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:15.807983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:15.813207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:15.945620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01be-58b9-4834-ab51-2325bd36c91c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:15.989424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:15.990550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:15.990833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:15.991109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] PATH_INFO: `/v3/users/9ab29a96b7f245e482c4b00b767803a9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:15.992423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab29a96b7f245e482c4b00b767803a9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:15.993916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:15.995561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 76/153] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:15 2022] GET /identity/v3/users/9ab29a96b7f245e482c4b00b767803a9 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:16.001296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:16.132276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351eb17-34cd-42be-a48a-f18dba90a713 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:16.169101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:16.170148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.170625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.171089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.251834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:16.253659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fe64-2ab5-4304-902f-cbd5f92b6e3d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:16.357056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:16.363425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:16.500426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86977-9579-4069-886c-b6cb47bf5633 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:16.538973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:16.539834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.540116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.540392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.541588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:16.543057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:16.545081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 77/155] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:16 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:16.550509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e125-5e7d-4d0c-a8fa-d29632fc12ab None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.551020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e125-5e7d-4d0c-a8fa-d29632fc12ab None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.552011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e125-5e7d-4d0c-a8fa-d29632fc12ab None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.553792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 79/156] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:16.556112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:16.564701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.565243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.565732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.590638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:16.592170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:16.684095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 80/157] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:16.687168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05dc51-d4b2-4e6e-96e4-f3fde5513624 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:16.736334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:16.737293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:16.738037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.738323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.738705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.739698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=9ab29a96b7f245e482c4b00b767803a9) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:16.739871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:16.741613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:16.749687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 78/158] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:16 2022] GET /identity/v3/role_assignments?user.id=9ab29a96b7f245e482c4b00b767803a9&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:16.866655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164741e-386d-4e59-bfa4-9c48077c020b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:16.916368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:16.917447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:16.917894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:16.918308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:16.938893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a0738a01-72a1-40c7-a5d2-373a0c81df65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:16.947351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:16.948450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:16.949401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:16.951610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 81/159] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:16.957687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.088910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7df7f-9395-479a-b7be-8290aa4f178b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:17.130110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:17.131125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.131592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.132022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.132993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:17.133440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:17.135026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297052-e3a5-4ed0-9009-685b4ff758d0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:17.139794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b1aa-8852-47ae-aeae-4db982fc29de None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.140318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b1aa-8852-47ae-aeae-4db982fc29de None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.140740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b1aa-8852-47ae-aeae-4db982fc29de None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.142430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 82/160] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:17.150083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 79/161] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:17.155364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b1aa-8852-47ae-aeae-4db982fc29de None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.157843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.158276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.158678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.178053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:17.179601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:17.267966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:17.320211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.384849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b1aa-8852-47ae-aeae-4db982fc29de None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:17.458520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486184-911c-47ef-8d67-4ab06ff68935 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:17.485828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:17.486713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.487032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.487266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.488497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:17.498979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41c57-12bc-4e64-a3f8-6f9ba548d3e4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:17.500738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:17 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:17.502012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7901d9-7cf0-47dc-8d8b-04426a62e236 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.502407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7901d9-7cf0-47dc-8d8b-04426a62e236 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.502688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7901d9-7cf0-47dc-8d8b-04426a62e236 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.504040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 84/164] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:17.509922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.510212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.510504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.511890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:17.512948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.513402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.513915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.530947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:17.541668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:17.541668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:17.544419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:17.545264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:17.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:17.548143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:17.549051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.681500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566b9-d90a-4a98-a7e4-e7c4ed0acbd6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:17.723016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:17.723944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.724194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 85/166] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:17.724514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.724928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.725093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.800555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:17.802852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:17.909904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:17.911195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:17.936413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e09211-da38-43ca-a9e5-369cb5d03953 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:17.977671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:17.977671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:17.977671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:17.977671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:17.978129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:17.978129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:17.978757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.000425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 86/168] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.003202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.098824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca87d09-0ebf-4bbe-9c19-7ed13c15009a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.141535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.142363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.142642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.142914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.165195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:18.173638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:18.174581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:18.175379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:18.183989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 83/169] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:18.184946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.241299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90de76d-aec4-449e-94e1-870c1a20feeb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.283246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.284541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.285068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.286095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.287542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.289273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.291214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 87/170] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.292367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.292632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6a74-bb35-4b81-a042-60b52209a139 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.335718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.336736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.336941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.337165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.342441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.343893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.345522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 84/171] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.346303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.412365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051684b-3a92-44dc-9ffa-0bc40730388f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.458954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.459629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.459907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.460179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.460923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:18.461224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.463740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.482264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 88/172] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.483109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.549604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd213-c412-480b-b4e5-a5ef6f5af254 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.603652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.604320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.604596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.604864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.605816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:18.606126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.607552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.620997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 85/173] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.621896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:18.678556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e83b-db00-41f4-a218-0de22993e366 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.745578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.746263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.746540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.746806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.854211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf8d0-aee6-408a-b88b-86a8a4ef10f3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:18.870138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.871635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856e3bc-248a-4c6a-9812-5f63b50ffe8e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.924798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:18.925841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:18.925971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:18.929731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] PATH_INFO: `/v3/users/37a535f74d794b958f30b4b934376917` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:18.929731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] RBAC: Authorizing `identity:get_user(user_id=37a535f74d794b958f30b4b934376917)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:18.929731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:18.940815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 86/174] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/users/37a535f74d794b958f30b4b934376917 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:18.951489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.069719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 89/175] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:19.071178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d632b3-616a-4982-8fe2-ee762d791fbc None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.071464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d632b3-616a-4982-8fe2-ee762d791fbc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.071735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d632b3-616a-4982-8fe2-ee762d791fbc None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.073430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 90/176] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:19.079066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d632b3-616a-4982-8fe2-ee762d791fbc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.195631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d632b3-616a-4982-8fe2-ee762d791fbc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.206831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5abc-04f7-4f3b-b027-6926ab112450 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.241695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.242589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.242865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.243142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.250814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:19.252162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f06e9-1538-4d28-93ab-9623c686936b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:19.254030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 91/177] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:19.256058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.256340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.256612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.300391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:19.301839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:19.311658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.312322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.312610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.312883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.419380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:19.421529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b390d-f0fc-4a4f-acbc-17891af1f848 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:19.490096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 92/178] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:19.490096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83694a-be38-4567-b443-b1a9375cb3da None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83694a-be38-4567-b443-b1a9375cb3da None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83694a-be38-4567-b443-b1a9375cb3da None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 88/180] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:19.558727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6477-b30d-46a2-9ddd-ed69a82b122d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.559515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6477-b30d-46a2-9ddd-ed69a82b122d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.559515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6477-b30d-46a2-9ddd-ed69a82b122d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.560485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 89/181] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:19.565194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c6477-b30d-46a2-9ddd-ed69a82b122d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.596886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd762-ba97-457a-84d1-9932fcc0e8ca None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.634188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.634834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.635113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.635386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.636204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:19.636514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:19.637962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:19.643585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 93/182] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:19.643585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.667536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c6477-b30d-46a2-9ddd-ed69a82b122d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.703294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.704098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.704379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.704653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.716288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-58559c3e-de46-4baa-bfd6-d79854832b6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:19.724624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:19.725775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:19.726785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 90/183] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:19.727677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11b0-29e8-4bef-ba68-55054e2eb711 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.727677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11b0-29e8-4bef-ba68-55054e2eb711 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.727677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11b0-29e8-4bef-ba68-55054e2eb711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.745631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-51fb11b0-29e8-4bef-ba68-55054e2eb711 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:19.746770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-51fb11b0-29e8-4bef-ba68-55054e2eb711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:19.760393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6313a-62f5-4cff-ab81-5d07a45a52b5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.796482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.797350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.797630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.797932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] PATH_INFO: `/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.799202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] RBAC: Authorizing `identity:get_project(project_id=576b6c139b5a47dc9c6420d2d40abe4f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:19.800653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73b337-7a3f-4165-8b4c-857bb7823ddf None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:19.808124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 94/184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/projects/576b6c139b5a47dc9c6420d2d40abe4f => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:19.808124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.808124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.808124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.822822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 91/185] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:19.824065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfb4d-6c49-438a-a6a6-95e6bac0fd67 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.824422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfb4d-6c49-438a-a6a6-95e6bac0fd67 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.824517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:19.824771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfb4d-6c49-438a-a6a6-95e6bac0fd67 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.825611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:19.826252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 92/186] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:19.833759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfb4d-6c49-438a-a6a6-95e6bac0fd67 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.894651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 95/187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:19.896158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:19.952110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfb4d-6c49-438a-a6a6-95e6bac0fd67 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.984350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:19.985011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.985287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.985565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:19.986330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:19.986637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:19.988007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b1e3c-89c0-4c90-b139-45c3e734b416 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:19.994303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6bb1f-ebe7-45a4-a8cc-4e1d5295d5d7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:19.996404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 93/188] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:19.997544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2655-e487-409f-9de7-289327c5b680 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:19.997868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2655-e487-409f-9de7-289327c5b680 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:19.998140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2655-e487-409f-9de7-289327c5b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.013965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-425e2655-e487-409f-9de7-289327c5b680 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:20.015119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-425e2655-e487-409f-9de7-289327c5b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:20.027350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.027999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.028281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.028555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.029381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=576b6c139b5a47dc9c6420d2d40abe4f, user.id=37a535f74d794b958f30b4b934376917) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:20.029718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.031148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.037603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 96/189] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:19 2022] GET /identity/v3/role_assignments?user.id=37a535f74d794b958f30b4b934376917&scope.project.id=576b6c139b5a47dc9c6420d2d40abe4f&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.037603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.097682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 94/190] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:20.097682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2655-e487-409f-9de7-289327c5b680 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.142686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c45af1-24cf-452c-b6f9-bfce20c0d74d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.178327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.179553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.179861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.180140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.191378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:20.200881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:20.201884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:20.202738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 97/191] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:20.206594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.215618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2655-e487-409f-9de7-289327c5b680 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.257550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.258299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.258581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.258853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.260021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.261495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.266800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.266800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.310503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fcced-9e5a-4ed2-b484-3792e2c41bfa None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.342564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.343421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.343697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.343967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.357381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.358880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.360522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.361375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.365459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5c45-82df-40e5-ae03-55c528662850 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.398601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.399378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.399655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.399925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.409427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:20.417596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:20.418699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:20.424651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.457287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2e5db-15a9-41b2-8340-9a28e292bdcb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.491380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.492036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.492311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.492581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.493314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:20.493622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.495001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.502489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 99/195] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.503260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.519495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e7ce-4ba1-449c-92b0-d0bf0e0f301e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.552077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.552736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.553012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.553282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.554012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.555444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.584006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 97/196] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:20 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:20.584664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.621419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a631e-4ee3-4fe5-9818-7bb63e2a5d00 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.661997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.663463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.663463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.663463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.694833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f201c2-b034-407e-a6d1-8b8d2cacd6ae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.731697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.732433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.732721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.732993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.733802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:20.734112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.735574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.736498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.738022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.745458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.747016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.844617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:20.845590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.861400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1180-8270-4bcb-b79f-582e1978ac9f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.908565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.909796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.910259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.911342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.912779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.914556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:20.916713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:20.917689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:20.958850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a03a5-3397-4429-8561-d030cfe528f9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:20.994286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:20.995452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:20.995937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:20.996386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] PATH_INFO: `/v3/users/fdc9491644a74f6a9a8b6b86cc454fba` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:20.997804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] RBAC: Authorizing `identity:get_user(user_id=fdc9491644a74f6a9a8b6b86cc454fba)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:20.999432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.001564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 101/200] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/users/fdc9491644a74f6a9a8b6b86cc454fba => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:21.002565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.029819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95f10-c43c-4265-93f1-c7b814d63e8e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.064613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.065855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.066343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.067435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.069029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.070746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.072721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 100/201] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:20 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:21.073863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.130758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433790-4c40-4392-95b6-a817c2cf219a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.166164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.167218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.167704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.168202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.175808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb47bd-95d7-4bd1-892b-a89017f51546 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.209454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.210130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.210413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.210675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.240160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.242051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.276139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.277600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.351013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:21.352408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.391819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:21.392643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.465298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d82fb-a18e-49cb-b0e4-e5fe7bd3278c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.491067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d1863-fb5e-4b36-811a-59d6bd359779 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.503836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.505870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.506360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.506858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.507895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=e29fbf70498f4cf69751692fff80806f) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:21.508411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.510118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.516338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 103/204] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/role_assignments?user.id=e29fbf70498f4cf69751692fff80806f&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:21.517466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.525448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.526364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.526640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.526908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.528375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.529741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.531614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 102/205] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:21.537435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.630777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41d54-c102-40e8-9d7d-ff16808b320c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.644166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b087-735c-48bb-912a-760b88ad4fcb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.669103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.670376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.670865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.671340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.672882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.674692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.677840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 104/206] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:21.686825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:21.693967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.694639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.694913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.695183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.696026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=e29fbf70498f4cf69751692fff80806f) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:21.696333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.698831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd489-65d1-4820-b027-418838b0f5f6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.715200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/role_assignments?user.id=e29fbf70498f4cf69751692fff80806f&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:21.848936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab1bf4-d0c6-46f8-9a1d-d2f1f396f273 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:21.893605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:21.894786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:21.895289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:21.895767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:21.896809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, scope.project.id=17b60329ab4e47b9839db2418e4f4878, user.id=fdc9491644a74f6a9a8b6b86cc454fba) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:21.897343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:21.899033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba25e-9041-4efb-ae0e-38c0ecd1eefc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:21.909885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:21 2022] GET /identity/v3/role_assignments?user.id=fdc9491644a74f6a9a8b6b86cc454fba&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:23.123862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333848-4f0c-4e9d-9a5a-b3c86035b0ca None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.124390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333848-4f0c-4e9d-9a5a-b3c86035b0ca None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.124390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333848-4f0c-4e9d-9a5a-b3c86035b0ca None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.126143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 104/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:23.132905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8203fc-9600-44e1-bfa7-8aa8249fa5a7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.133420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8203fc-9600-44e1-bfa7-8aa8249fa5a7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.133494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8203fc-9600-44e1-bfa7-8aa8249fa5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.151040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-eb8203fc-9600-44e1-bfa7-8aa8249fa5a7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:23.152384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-eb8203fc-9600-44e1-bfa7-8aa8249fa5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:23.221570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:23.245886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333848-4f0c-4e9d-9a5a-b3c86035b0ca None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.248078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766406b-e207-4b0f-985f-75dccd0485fe None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.248365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766406b-e207-4b0f-985f-75dccd0485fe None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.248640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766406b-e207-4b0f-985f-75dccd0485fe None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.250257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 107/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:23.255235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.255517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.255790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.272467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:23.273618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:23.340216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:23.354799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333848-4f0c-4e9d-9a5a-b3c86035b0ca None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.365334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.396574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.398094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.398594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.399059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.411974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:23.422412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:23.423474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:23.424340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:23.427113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:23.433290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.472697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c0613-f1f3-4218-bcf5-f643eac9e710 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.505795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.506877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.506986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.507344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.508581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:23.510231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:23.511939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:23.517289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.537965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a9a49-a65f-48c0-b817-52beee82f495 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.571715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.572665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.573145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.573610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.574576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:23.575096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:23.576658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:23.585600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:23.593812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.621494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2495a9b-d32b-48d5-a38d-097c13243f3e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.656826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.657481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.657810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.658087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.658795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:23.660243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:23.685685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 110/216] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:23 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:23.709519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c354-06ed-461d-bd46-100372af93a5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.754071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.756041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.759003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.764267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] PATH_INFO: `/v3/users/4c032ba1153840319f2ce3ea9a94918d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.781763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] RBAC: Authorizing `identity:get_user(user_id=4c032ba1153840319f2ce3ea9a94918d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:23.783608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633306-8a01-4fab-9257-c86fd933dea7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:23.786754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 107/217] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:23 2022] GET /identity/v3/users/4c032ba1153840319f2ce3ea9a94918d => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:23.792924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:23.904296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701ea8-7e99-41eb-90c7-bda9dca42d84 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.904667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701ea8-7e99-41eb-90c7-bda9dca42d84 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.905030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701ea8-7e99-41eb-90c7-bda9dca42d84 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.906638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 108/218] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:23.908742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0933a-caf8-4b96-ae6f-e9eea3da4288 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:23.911818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.912173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.912519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:23.930934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:23.932117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:23.946247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:23.946902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:23.947181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:23.947456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.025377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:24.033499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.035923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.050058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.163617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 14:42:24.169061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.174188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851dada-70e1-43ce-b7de-f4ed16e8e84f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.213510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.213734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.213973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.214177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.225966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:24.233638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:24.234556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:24.235320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:24.241499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:24.242439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.291205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce96d-ef02-4ea9-bd3c-d2d9eb2b784b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.327536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.327809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.328076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.329303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.330892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28634253-ef01-4cfa-a16e-224a0fe984c4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.333264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 112/222] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:24.333913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226515-c241-495a-acbb-11d35285b139 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.334254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226515-c241-495a-acbb-11d35285b139 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.334531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226515-c241-495a-acbb-11d35285b139 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.336091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 113/223] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:24.340525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226515-c241-495a-acbb-11d35285b139 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.355471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09afc-3512-448d-869e-d02e187f81fe None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.390388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.391394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.391868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.392333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.393264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:24.393832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.396094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134a29-eacd-4e12-994e-0564b8cea272 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.404647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 111/224] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:24.406155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.406639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.407130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.433846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:24.435012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:24.463264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226515-c241-495a-acbb-11d35285b139 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.508030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 112/225] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:24.508916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.509173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.510063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.510544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.511218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.513044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=4c032ba1153840319f2ce3ea9a94918d) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:24.513561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.515204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.523021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/role_assignments?user.id=4c032ba1153840319f2ce3ea9a94918d&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:24.533485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.668011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7a21-d060-4dd8-9f2d-c492c922abfb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.713039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.713857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.714135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.714463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.718427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.719944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.721962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:24.728533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.736836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1c0d-72ae-483c-ad4b-4d1bf4cd96e4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.796473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.797690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.798173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.798671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.810371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:24.821774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:24.822710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:24.823529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:24.826228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:24.834664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.839175 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817bd99-d2b9-441b-9f88-e2355573d4f6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:24.876932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:24.877809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:24.878079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:24.878344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:24.880726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:24.882211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:24.884064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:24.889941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:24.991889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97b24-b746-45df-b3d3-190f48d6df09 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:25.058297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:25.059029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:25.059310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:25.059592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:25.060336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:25.060643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:25.062105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:25.078901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:25.088038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0713-1b90-4c3f-8773-686f8347ffa2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:25.088215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:25.159195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:25.161159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:25.161718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:25.162212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/e29fbf70498f4cf69751692fff80806f/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:25.167052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, user_id=e29fbf70498f4cf69751692fff80806f, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:25.168673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:25.204185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:24 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/e29fbf70498f4cf69751692fff80806f/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:25.215027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b821e-6eba-42e4-9a33-02901934fef8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:25.262624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:25.263448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:25.263729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:25.264004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:25.265339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:25.266815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:25.268735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:25 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:25.274989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:25.442378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d96e3-e7cf-49b1-9482-8eaf55ab8e38 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:25.493568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:25.494469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:25.494750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:25.495022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:25.497049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:25.498545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d7bd-20ae-4af0-80d4-358c423f0e28 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:25.500261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:25 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:25.507528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:25.616265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff91733-736f-48e7-ac78-9600fc1d3b2f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:25.650349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:25.651645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:25.652126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:25.652604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/e29fbf70498f4cf69751692fff80806f/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:25.655045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, user_id=e29fbf70498f4cf69751692fff80806f, role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:25.656697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b33986-6ad5-4d32-bf53-37837ed1b3e4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:25.680302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:25 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/e29fbf70498f4cf69751692fff80806f/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:26.607648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f5da-5eda-44c2-9f0d-bd2c09c6be7d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:26.608157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f5da-5eda-44c2-9f0d-bd2c09c6be7d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:26.608232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f5da-5eda-44c2-9f0d-bd2c09c6be7d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:26.609818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:26.615632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:26.616571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:26.617047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:26.638382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:26.639929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:26.653469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343be69f-8664-48e9-a347-b82af38bfce6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:26.653827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343be69f-8664-48e9-a347-b82af38bfce6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:26.654056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343be69f-8664-48e9-a347-b82af38bfce6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:26.655435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 118/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:26.678367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:26.678705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:26.678911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:26.698367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:26.700606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:26.763948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:26.774484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 05 14:42:26.798532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:26.813354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:26.917308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cbe3b-aba1-4b16-ae01-0d049f58ddfb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:26.955951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:26.957192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:26.957964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:26.959825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:26.961264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:26.963700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:26.966359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:26.974506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:26.994126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3dba-23e5-4ea8-b104-56644fbe6a62 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.070389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.071210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.071493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.071768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.084622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d23d-51b0-4e8d-b10f-4d2192facb30 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.102912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:27.117631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:27.118576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:27.119461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:27.123287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:27.129971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.130585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.130711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.130911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.131181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.131888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:27.133535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:27.166416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 121/241] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:26 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:27.288295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ca7f-71f3-411b-ae05-304ceac73896 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.332858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.333987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.334474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.334970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.335946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:27.336461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:27.338148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a469f-1c7e-4668-a775-c16e1f633a2f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:27.354350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 121/242] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:27.359886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.424777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50d698-fad4-4106-924a-b3ba67e85b1e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.425458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50d698-fad4-4106-924a-b3ba67e85b1e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.433947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50d698-fad4-4106-924a-b3ba67e85b1e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.433947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 122/243] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:27.439828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.440346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.440820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.462447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:27.463956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:27.485307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db59a8-43d6-448d-ac53-5ba677255040 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.525501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.527738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.527738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.527738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] PATH_INFO: `/v3/users/a993d816b60b419c9eb52da192634693` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.545958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=a993d816b60b419c9eb52da192634693)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:27.547681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:27.549759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 122/244] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/users/a993d816b60b419c9eb52da192634693 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:27.552069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:27.555864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.585561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.664861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1c656-dbdd-4574-a542-c98a30287fa1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.700782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.701808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.702289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.702787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.713416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981dc2-aacf-43a2-945b-81f5efd7a2b2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.757800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.758594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.758877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.759153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:27.776270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:27.778070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:27.786903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:27.794573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:27.795441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:27.796269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 124/246] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:27.805337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.895613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:27.901106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:27.951026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b17aa-0fc4-4d4f-bd72-44778bc5e1de None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:27.998220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:27.998894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:27.999304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:27.999580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.000397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:28.000702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.006727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.018438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:28.024811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.035849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9ee26-c852-44c8-b930-094bfcc02ad1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.117153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.117968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.118252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.118525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.119731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.121201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.123287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 124/249] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:27 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:28.129841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.145622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438131-a303-46d8-a9ef-d2efd50132f7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.182659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83487727-156b-4341-8a31-81dada597c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.183768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487727-156b-4341-8a31-81dada597c51 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.184188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487727-156b-4341-8a31-81dada597c51 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.184597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487727-156b-4341-8a31-81dada597c51 None admin] PATH_INFO: `/v3/users/4c032ba1153840319f2ce3ea9a94918d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.185985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83487727-156b-4341-8a31-81dada597c51 None admin] RBAC: Authorizing `identity:get_user(user_id=4c032ba1153840319f2ce3ea9a94918d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.188384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83487727-156b-4341-8a31-81dada597c51 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.190909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 126/250] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/users/4c032ba1153840319f2ce3ea9a94918d => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:28.197711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529ccb-5c2d-4cc4-aa3e-0e0bff994e49 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529ccb-5c2d-4cc4-aa3e-0e0bff994e49 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.199229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529ccb-5c2d-4cc4-aa3e-0e0bff994e49 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.200739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 127/251] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:28.203002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be529ccb-5c2d-4cc4-aa3e-0e0bff994e49 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.343642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb284-a891-4db5-819d-a5ff9b50a150 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.352702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be529ccb-5c2d-4cc4-aa3e-0e0bff994e49 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.401987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.402571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.402849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.403121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.403949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=a993d816b60b419c9eb52da192634693) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:28.404309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.405715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.410110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.411068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.411349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.411622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.413420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.414892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698835c5-a749-415f-9830-c7a2eba9c97d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.416600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 128/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:28.417902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb151-283c-4527-aa6e-bb1f9f96a185 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.418035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb151-283c-4527-aa6e-bb1f9f96a185 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.418314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb151-283c-4527-aa6e-bb1f9f96a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.421551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 125/253] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/role_assignments?user.id=a993d816b60b419c9eb52da192634693&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:28.432217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.452493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-3b7eb151-283c-4527-aa6e-bb1f9f96a185 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:28.453750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3b7eb151-283c-4527-aa6e-bb1f9f96a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:28.589852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 129/254] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:28.603329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff6862-bde6-4830-872e-2ca9184936e5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.648098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.648998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.649280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.649553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/4c032ba1153840319f2ce3ea9a94918d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.651665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, user_id=4c032ba1153840319f2ce3ea9a94918d, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:28.653203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea844b3-b265-4e0d-975a-1418e30404e9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:28.658705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1a7f-39be-4957-95fc-09b920f40598 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.659067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1a7f-39be-4957-95fc-09b920f40598 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.659271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1a7f-39be-4957-95fc-09b920f40598 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.661962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 130/255] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:28.668117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab1a7f-39be-4957-95fc-09b920f40598 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.671673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 126/256] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:28 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/4c032ba1153840319f2ce3ea9a94918d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:28.673485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.673985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.674463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.702759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:28.704416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:28.790453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab1a7f-39be-4957-95fc-09b920f40598 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:28.805475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 127/257] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:28.842116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.861312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:28.862156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:28.862437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:28.862712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:28.887211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:28.895744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:28.896687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:28.897477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 131/258] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:28.908073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:28.992698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ae355-a3e3-4423-b89b-1fb41319aac5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.056373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.057190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.057469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.057766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.078755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:29.089305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:29.090457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:29.091414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:29.098277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 128/259] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:29.104173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.116623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc392f1-6175-4e1b-99e3-c33212057a66 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.199721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.200388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.200664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.200935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.201691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:29.201996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.203355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.216776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d025-3dff-415e-9752-f59db88e2fcc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.220070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:29.243073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.256611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.257321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.257607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.257901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.258651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:29.258955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.260333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.268773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 129/261] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:29.275253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.431807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe5b5-85fe-4ed3-acb5-34025a547be6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.469420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.470633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.471059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.471477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.473417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.475550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.481900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 133/262] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:29.483719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.527922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58c87-542d-4d1b-a8bb-f136f726658d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.594346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fa97-d22c-4182-9860-0777cad26935 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.622367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.623410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.623530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.623772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] PATH_INFO: `/v3/users/e29fbf70498f4cf69751692fff80806f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.624993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] RBAC: Authorizing `identity:get_user(user_id=e29fbf70498f4cf69751692fff80806f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.626448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.628067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 130/263] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/users/e29fbf70498f4cf69751692fff80806f => generated 283 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:29.632471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.633390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.633866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.634084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.634571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.704512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.706466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.803865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8b0cd-8958-4359-b3f1-21fdd16bc879 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.821503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 134/264] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 14:42:29.823358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:29.886875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.887566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.887798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.888081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.926098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568e3b5-9a6f-4955-9095-fb8489dbe6ab None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:29.961029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:29.962155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:29.962610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:29.963042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:29.964436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:29.966125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:29.973468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 135/265] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:29.978848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:30.007415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:30.009120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:30.117872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866229c-d4cc-40e8-9e42-bd4ac90c8372 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:30.192404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 131/266] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 14:42:30.199517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:30.206452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:30.207178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.207574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.207959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.208805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=e29fbf70498f4cf69751692fff80806f) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:30.209116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:30.210603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:30.232064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 136/267] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:29 2022] GET /identity/v3/role_assignments?user.id=e29fbf70498f4cf69751692fff80806f&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:30.379933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fe5a-35dc-4166-8a1c-8a73ac1e3332 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:30.427971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:30.429199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.429710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.430570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.433673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:30.433673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e944-e0dc-4a3f-abed-1c57740186ad None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:30.439841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 132/268] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:30 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:30.441193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:30.594214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007c10-4456-4865-9e70-5120b252f54d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:30.632289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:30.632879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.633161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.633435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.634311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=e29fbf70498f4cf69751692fff80806f) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:30.634627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:30.636076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d37c-4c03-4533-b868-d6da7374ed7c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:30.642720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 137/269] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:30 2022] GET /identity/v3/role_assignments?user.id=e29fbf70498f4cf69751692fff80806f&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:30.848045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d16936-2102-48f1-b56e-db3895f2bab9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.848656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d16936-2102-48f1-b56e-db3895f2bab9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.848656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d16936-2102-48f1-b56e-db3895f2bab9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.850157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 133/270] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:30.857011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.857424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.857614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.880322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:30.881520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:30.916077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80654-3207-4489-a517-8f44d4e56526 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.916359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80654-3207-4489-a517-8f44d4e56526 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.916554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80654-3207-4489-a517-8f44d4e56526 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.918152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 134/271] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:30.923893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:30.924476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:30.924761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:30.949316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:30.951285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:30.986507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:31.029704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.037553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:31.063778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.137022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42ef17-ac16-4c38-a83e-652a451a459f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.164343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277038b-b374-407a-be83-d5e1926ca2bf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.173914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.174649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.174924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.175192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.185922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:31.194573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:31.196623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:31.198631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 139/274] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:31.203506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.206627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.208451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.208733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.209008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.211151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:31.212638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:31.214314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 136/275] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:31.222788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.335611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9911034-f417-4ad9-910b-488e925d4d38 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.354495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063bfc-caa8-4532-89cf-0f1d1c03a723 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.380749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.381705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.381988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.382256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.383489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:31.383798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:31.385629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:31.394954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.395800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.396151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.396493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.397268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:31.398669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 140/276] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:31.398867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:31.404061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.421407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 137/277] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:31 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:31.544883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0feb6c-6730-4546-8311-6c50a59fa596 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.581386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.582874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.583161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.583429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] PATH_INFO: `/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.599230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] RBAC: Authorizing `identity:get_user(user_id=8fd478a9a7d94fb0aa1fe1fcde4d18de)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:31.600789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3e4ce-d34d-4be5-b848-9d12bb61972d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:31.602650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:31.608829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.655299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910302a0-9364-4e52-b98e-6f6000d7afab None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.655700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910302a0-9364-4e52-b98e-6f6000d7afab None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.656047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910302a0-9364-4e52-b98e-6f6000d7afab None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.657696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 142/279] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:31.667443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.667722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.667999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.686770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:31.687859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:31.717579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24208f-7fc4-4a4f-908e-4783ac98913b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:31.770973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:31.772020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:31.772525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:31.773012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:31.774073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, user.id=8fd478a9a7d94fb0aa1fe1fcde4d18de, scope.system=all) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:31.774511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 143/280] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:31.774827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:31.776372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:31.782109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 138/281] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/role_assignments?user.id=8fd478a9a7d94fb0aa1fe1fcde4d18de&scope.system=all&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:31.800100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:31.949609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f501-5649-446b-ac63-cc4a6a32b6f1 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.001838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.002649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.002923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.003190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.016755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:32.025653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:32.026538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:32.027322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 144/282] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:32.034788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.138078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a84c2-284d-4496-84c1-fae0c48cd3a4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.177527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.178627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.179160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.179633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.180637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:32.181139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:32.182776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f12e93-2945-49f1-bbc5-aef4f013c98b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:32.192701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 139/283] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:32.202782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.227370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ce6d-d380-47d8-8e28-9563300388a4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.227669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ce6d-d380-47d8-8e28-9563300388a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.227927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ce6d-d380-47d8-8e28-9563300388a4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.229419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 140/284] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:32.235220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.235506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.235785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.258052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:32.259720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:32.337744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 141/285] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:32.381720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8f99f-5deb-4c9f-82d5-9c47c6975600 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.424937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.426289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.426877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.427343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] PATH_INFO: `/v3/users/a993d816b60b419c9eb52da192634693` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.428777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] RBAC: Authorizing `identity:get_user(user_id=a993d816b60b419c9eb52da192634693)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:32.430889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:32.433188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 145/286] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/users/a993d816b60b419c9eb52da192634693 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:32.437729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.439236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.549221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c47b1-9b14-4646-9a49-e576dc5f8d12 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.591268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.592129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.592405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.592674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.599900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:32.601372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:32.604300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 142/287] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:32.610691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.627594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c2bd-48d7-4c04-9c30-bbafdb044a20 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.682345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.683517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.684030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.684521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.708424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:32.721672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:32.722633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:32.723414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:32.725872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 146/288] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:32.728935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a03df-80a1-47f8-9146-b077d17d8adc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.731768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:32.772641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.773539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.773843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.774116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/a993d816b60b419c9eb52da192634693/roles/d2c8e940ae324570852a3cbfabc8e798` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.778704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, user_id=a993d816b60b419c9eb52da192634693, role_id=d2c8e940ae324570852a3cbfabc8e798)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:32.780153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:32.808669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 143/289] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:42:32 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/users/a993d816b60b419c9eb52da192634693/roles/d2c8e940ae324570852a3cbfabc8e798 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:42:32.873669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7ca6-7655-420a-ab61-cecdb1009284 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:32.916492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:32.917196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:32.917480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:32.917782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:32.918641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:32.918956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:32.920364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:32.930263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 147/290] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:32.936055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:33.063821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fdcf0-182c-4c9f-9b0a-f48fc83a0355 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:33.100919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:33.102377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:33.102928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:33.103419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] PATH_INFO: `/v3/users/4c032ba1153840319f2ce3ea9a94918d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:33.104805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] RBAC: Authorizing `identity:get_user(user_id=4c032ba1153840319f2ce3ea9a94918d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:33.106465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:33.108591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 144/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:32 2022] GET /identity/v3/users/4c032ba1153840319f2ce3ea9a94918d => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:33.115002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:33.276314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f578f4-1636-4b99-802a-0eee0a935ffb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:33.318445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:33.319027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:33.319313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:33.319588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:33.407674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:33.409146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:33.539412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 148/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:33.544954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:33.700012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ee083-b36b-4237-8e39-63fa6a9b791d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:33.740862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:33.741735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:33.742011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:33.742280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:33.746426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:33.747856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93df88-34b2-48f6-9e90-6a99108ae864 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:33.749802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 145/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:33 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:33.756148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:33.921717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69525e4-6f76-440a-90b8-516354ededb9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:33.966529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:33.967550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:33.968034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:33.968507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:33.969534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=4c032ba1153840319f2ce3ea9a94918d) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:33.970130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:33.971753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e126d3e-d168-418c-9ff1-b8253290fd91 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:33.985779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 149/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:33 2022] GET /identity/v3/role_assignments?user.id=4c032ba1153840319f2ce3ea9a94918d&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:34.211057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdb75-b684-4e81-ac98-13e37f47d197 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.211572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdb75-b684-4e81-ac98-13e37f47d197 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.211572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cdb75-b684-4e81-ac98-13e37f47d197 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.213198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 146/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:34.218848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.219719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.220206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.239160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:34.240769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:34.311735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 150/296] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:34.335881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cdb75-b684-4e81-ac98-13e37f47d197 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.457937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cdb75-b684-4e81-ac98-13e37f47d197 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:34.495272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:34.495993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.496273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.496548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.506981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0ef9fca1-dd90-4136-9d28-90ab8653699f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:34.514704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:34.515587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:34.516369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 147/297] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:34.522588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.564859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb951-50bf-4e65-9a9e-caddd2f9a3e8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.565194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb951-50bf-4e65-9a9e-caddd2f9a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.565407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb951-50bf-4e65-9a9e-caddd2f9a3e8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.569368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 148/298] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:34.575156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.575479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.575735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.595805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:34.596993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:34.641297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f460c9-d0b5-401b-85e7-626801572b9a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:34.670780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:34.677933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:34.678837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.679308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.679771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.680793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:34.681289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:34.682863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:34.693425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.694195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 151/300] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:34.700606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.793901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffd395-b79e-420e-b397-08961a94de6a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:34.811395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc6ab-f7eb-4148-94ac-6e32d057fe42 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:34.827197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:34.827983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.828264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.828536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.829714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:34.831142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e2241-996a-4f4d-83a3-16e2867052ac None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:34.833094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 150/301] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:34.834332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e26b-da85-4539-84fd-214a2d4fa6f2 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.834621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e26b-da85-4539-84fd-214a2d4fa6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.834899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e26b-da85-4539-84fd-214a2d4fa6f2 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.836249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 151/302] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:34.840920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e26b-da85-4539-84fd-214a2d4fa6f2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.852690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:34.853559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.853879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.854157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] PATH_INFO: `/v3/users/4c84bf93454445f7a7baba305020d159` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.868445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] RBAC: Authorizing `identity:get_user(user_id=4c84bf93454445f7a7baba305020d159)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:34.869928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe351e1-5234-4547-aa4f-d5eb1dcae082 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:34.871820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 152/303] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:34 2022] GET /identity/v3/users/4c84bf93454445f7a7baba305020d159 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:34.872993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.873284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.873565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.891732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:34.892906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:34.946619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e26b-da85-4539-84fd-214a2d4fa6f2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:34.957623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 153/304] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:34.958383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:34.990202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:34.990870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:34.991151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:34.991422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] PATH_INFO: `/v3/groups` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:34.992109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:34.993874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:35.008147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 152/305] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 5 14:42:34 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:35.009282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.066025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496475-c7a9-4c50-8c20-6c8c25c7ce69 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.104160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.105215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.105725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.106209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.107326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, user.id=4c84bf93454445f7a7baba305020d159, scope.system=all) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:35.107925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:35.109843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:35.116615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 154/306] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 5 14:42:34 2022] GET /identity/v3/role_assignments?user.id=4c84bf93454445f7a7baba305020d159&scope.system=all&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:35.141480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169b1f-378d-4e22-9c8a-849b179c4622 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.181094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955488-263c-419c-a142-49742f158c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.182011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955488-263c-419c-a142-49742f158c33 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.182292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955488-263c-419c-a142-49742f158c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.182571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955488-263c-419c-a142-49742f158c33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.196304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955488-263c-419c-a142-49742f158c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d4955488-263c-419c-a142-49742f158c33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:35.204214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:35.205201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:35.206002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:35.212702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.324310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fac3-b1c0-432a-842a-cbdedadc029d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.361426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.362153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.362434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.362770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.363581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:35.363942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:35.365360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:35.375263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 155/308] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:35.381543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955488-263c-419c-a142-49742f158c33 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.484174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955488-263c-419c-a142-49742f158c33 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.518165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.519037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.519879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.520343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] PATH_INFO: `/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.521559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd478a9a7d94fb0aa1fe1fcde4d18de)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:35.523037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a4789-a8eb-4c85-b6cc-7a398425a8b2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:35.524962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 154/309] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:35 2022] GET /identity/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:35.530504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.557607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee88b-6365-4e20-aa3b-407149bd297a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.557937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee88b-6365-4e20-aa3b-407149bd297a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.558220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee88b-6365-4e20-aa3b-407149bd297a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.559562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 155/310] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:35.564649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.564937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.565218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.582814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:35.583909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:35.643705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5dce2-727c-4e9c-892d-a8f68ac77782 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.652901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 156/311] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:35.676081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.680384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.681480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.681990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.682440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] PATH_INFO: `/v3/system/users/8fd478a9a7d94fb0aa1fe1fcde4d18de/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.684109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8fd478a9a7d94fb0aa1fe1fcde4d18de, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:35.685743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:35.696297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 5 14:42:35 2022] PUT /identity/v3/system/users/8fd478a9a7d94fb0aa1fe1fcde4d18de/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:35.795467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dac49-900b-4e90-b2dd-e0ff5761ec19 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:35.834263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:35.835055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:35.835345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:35.835620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:35.847229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:35.855577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:35.856531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:35.857309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 157/313] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:35.863929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:35.969757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa65878-5da1-4f4f-b490-5bd004be83f9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:36.005738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:36.006403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:36.006679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:36.006947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:36.007684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:36.007985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:36.009343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:36.018017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 157/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:36.023351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:36.126370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b39c9-12dd-4fa5-abff-2fab00eda1d1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:36.160696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:36.161664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:36.161954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:36.162230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] PATH_INFO: `/v3/users/a993d816b60b419c9eb52da192634693` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:36.163447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] RBAC: Authorizing `identity:get_user(user_id=a993d816b60b419c9eb52da192634693)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:36.164898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:36.166869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 158/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:36 2022] GET /identity/v3/users/a993d816b60b419c9eb52da192634693 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:36.172371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:36.278579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aa6e8-e8f0-4685-92e7-234e1eca2466 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:36.313101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:36.314045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:36.314328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:36.314606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:36.383530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:36.385425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:36.515342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:36.521616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:36.632652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b79c42-c18f-44cb-83c1-bfa3ed7f969c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:36.672489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:36.673295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:36.673578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:36.673882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:36.675188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:36.677238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823e3c5-ef9d-4410-b298-b407255023f7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:36.679507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:36 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:36.684988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:36.799554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789fb-51b1-4d67-a814-ddb5f30ba1fe None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:36.840509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:36.841548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:36.842055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:36.842523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:36.843557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, scope.project.id=6ebf0982a4fc497890f4a54b154129e5, user.id=a993d816b60b419c9eb52da192634693) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:36.844061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:36.845816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e44727-2e55-4666-8dd8-789edbc6ec52 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:36.852760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 159/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:42:36 2022] GET /identity/v3/role_assignments?user.id=a993d816b60b419c9eb52da192634693&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:37.489477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4d8e-923d-4d11-939d-71d6f4d80197 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.489818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4d8e-923d-4d11-939d-71d6f4d80197 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.490056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4d8e-923d-4d11-939d-71d6f4d80197 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.491568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 160/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:37.496753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7d228-efaf-4da9-a11f-77c14b213de8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.497214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7d228-efaf-4da9-a11f-77c14b213de8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.497317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7d228-efaf-4da9-a11f-77c14b213de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.514088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d9c7d228-efaf-4da9-a11f-77c14b213de8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:37.515314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d9c7d228-efaf-4da9-a11f-77c14b213de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:37.585133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 160/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:37.608339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b4d8e-923d-4d11-939d-71d6f4d80197 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:37.706979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b4d8e-923d-4d11-939d-71d6f4d80197 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:37.714311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3cf1-a444-4715-b181-e78ee72ec9f8 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.714608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3cf1-a444-4715-b181-e78ee72ec9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.714888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3cf1-a444-4715-b181-e78ee72ec9f8 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.716387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 161/321] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:37.721303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.721591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.721900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.738511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:37.739593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:37.739736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:37.740376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.740657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.740928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.742100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:37.743524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:37.745276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 161/322] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:37.750592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:37.806259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:37.828470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:37.848850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0fccc-8e0a-4ac3-b1d4-63216f501560 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:37.882203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:37.882862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.883146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.883419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] PATH_INFO: `/v3/groups` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.884096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:37.885531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:37.903112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 162/324] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 5 14:42:37 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:37.932360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767739b-ff06-446a-b094-926bbb96c0a5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:37.972841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:37.974097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:37.974392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:37.974676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:37.986067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f5a5e6ec-7f14-4848-af96-c8ca67dd5946 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:37.994681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:37.995634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:37.996420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 163/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:38.003210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.108464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5d4d-1947-4c39-8538-4bc60ae674f3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.131479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84bb7-4065-486d-9dbe-e9bae2315eb1 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.131765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84bb7-4065-486d-9dbe-e9bae2315eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.132040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84bb7-4065-486d-9dbe-e9bae2315eb1 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.133406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 164/326] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:38.138618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.138905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.139185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.145807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.146479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.146768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.147044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.147798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:38.148104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:38.149472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:38.157869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 163/327] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:38.161701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:38.162855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:38.164195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.255829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 165/328] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:38.273991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e598a4-fc7c-4713-8d48-859cf1d30652 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.280766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.312545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.313392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.313967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.314240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] PATH_INFO: `/v3/users/4c84bf93454445f7a7baba305020d159` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.315456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] RBAC: Authorizing `identity:get_user(user_id=4c84bf93454445f7a7baba305020d159)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:38.316944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:38.319121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 164/329] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/users/4c84bf93454445f7a7baba305020d159 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:38.324124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.421559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a23c-c220-429d-ac96-3519c2209b50 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.476167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e404f-20b3-4ac1-a04b-8505b21c28a2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.482289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.483364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.483863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.484333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.496908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:38.506326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:38.507193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:38.508060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:38.511054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 166/330] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:38.517671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.517671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.517671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.517671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] PATH_INFO: `/v3/system/users/4c84bf93454445f7a7baba305020d159/roles/d2c8e940ae324570852a3cbfabc8e798` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.518985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.519164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4c84bf93454445f7a7baba305020d159, role_id=d2c8e940ae324570852a3cbfabc8e798)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:38.520569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:38.533727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 165/331] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 5 14:42:38 2022] PUT /identity/v3/system/users/4c84bf93454445f7a7baba305020d159/roles/d2c8e940ae324570852a3cbfabc8e798 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:38.637497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebce91-ccde-43a4-beef-333490a9e97d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.677005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.677714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.678002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.678275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.679036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:38.679340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:38.680726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:38.695845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 167/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:38.701521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:38.825367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c507f-f667-4050-9516-b6f8bf4a67a7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:38.862272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:38.863724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:38.863999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:38.864273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] PATH_INFO: `/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:38.866703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd478a9a7d94fb0aa1fe1fcde4d18de)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:38.868151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213487-df53-45ff-87a9-216e22827a00 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:38.870222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 166/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/users/8fd478a9a7d94fb0aa1fe1fcde4d18de => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:38.875940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:39.013478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098035d-d8fd-431b-854f-2fa9c99a4154 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:39.052347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:39.053013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:39.053301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:39.053580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:39.054439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] RBAC: Adding query filter params (role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, user.id=8fd478a9a7d94fb0aa1fe1fcde4d18de, scope.system=all) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:39.054755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:39.056193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8c649-ffaf-497b-a19b-66a38dae20ef None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:39.073051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 168/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 5 14:42:38 2022] GET /identity/v3/role_assignments?user.id=8fd478a9a7d94fb0aa1fe1fcde4d18de&scope.system=all&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:41.053671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380b6f-b500-4b8d-89d5-d5dc198611c0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.054252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380b6f-b500-4b8d-89d5-d5dc198611c0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.054252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380b6f-b500-4b8d-89d5-d5dc198611c0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.055650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 167/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:41.061476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.062032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.062032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.086800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:41.088006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:41.171253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 169/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:41.215597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae380b6f-b500-4b8d-89d5-d5dc198611c0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:41.343512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae380b6f-b500-4b8d-89d5-d5dc198611c0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:41.389135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:41.389961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.390240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.390511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.406781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c1201fee-006a-4284-baf6-b7ada4d4d375 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:41.419411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:41.420374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:41.421211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 168/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:41.428463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:41.448325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e16ea-d91d-43b5-b9fd-9ff434648f41 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.448658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e16ea-d91d-43b5-b9fd-9ff434648f41 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.448871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e16ea-d91d-43b5-b9fd-9ff434648f41 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.450284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 169/338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:41.456323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef093-bfb7-4ab6-80d2-8fa658793b2b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.456661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef093-bfb7-4ab6-80d2-8fa658793b2b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.456917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef093-bfb7-4ab6-80d2-8fa658793b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.487455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-795ef093-bfb7-4ab6-80d2-8fa658793b2b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:41.489465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-795ef093-bfb7-4ab6-80d2-8fa658793b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:41.600761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 170/339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:41.602416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956396-35b9-4d6b-9997-dd372a9ba8bb None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.602867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956396-35b9-4d6b-9997-dd372a9ba8bb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.603335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956396-35b9-4d6b-9997-dd372a9ba8bb None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.604841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 171/340] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:41.610564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.611131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.611590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.617404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637f220-b3b3-4d65-b645-b2659758d2aa None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:41.638912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:41.640507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:41.681510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:41.682237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.682520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.682792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.683583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:41.683891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:41.685350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:41.701237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 170/341] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:41.705437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:41.754495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 172/342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:41.755664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:41.860281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1d07-baf1-4ee7-a75f-348df5f008d4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:41.895637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:41.896657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.897160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.897632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:41.921267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122a158-e63e-4088-8a9a-c48881a05877 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:41.968668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:41.970558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9095c-40df-45ad-a183-97dedec267ed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:41.997249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:41.998115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:41.998394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:41.998924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.009822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:42.017679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:42.018587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:42.019440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:42.025829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 171/343] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:42.025829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.092559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 173/344] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:42.094308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad904c-553d-4d18-80be-fecf4ade8983 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.094694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad904c-553d-4d18-80be-fecf4ade8983 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.095403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad904c-553d-4d18-80be-fecf4ade8983 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.097565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 174/345] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:42.098863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad904c-553d-4d18-80be-fecf4ade8983 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.142620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e9ff9-9d40-4a23-bf67-595b58371911 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.179401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.180551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.181198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.181683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.195501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:42.203766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:42.204672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 14:42:42.205516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:42.208236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 172/346] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:42.209331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.227456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad904c-553d-4d18-80be-fecf4ade8983 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.270182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.270851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.271131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.271405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.272160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:42.272468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.274266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657d194-609b-4894-83cf-8aadaa2a29b2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.288247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 175/347] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:42.289737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.290031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.290314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.311041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:42.312276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:42.362921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ede8f-f200-4fa0-badd-a1cbdcf5e7c5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.395068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 176/348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:42.395957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.406633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.408104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.408602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.409108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.411167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.413446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.415526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 173/349] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:42.416595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.521219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1d95-e5bb-41c9-818e-83338071fd4f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.545466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57362e-24d9-4932-b4e9-70723d205ce3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.562398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.563862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.564363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.564843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.565915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:42.567265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.568871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.580873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 177/350] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:42.582166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.590156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.590821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.591106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.591385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.670683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.672856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.703183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeba6a-2497-4eaf-a73c-d8a5760f9746 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.741853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.743531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.744268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.744744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.754526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.756034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.758394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 178/351] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:42.759022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.794159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 174/352] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:42.795503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.885840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31ac4-eab3-4f49-ad1e-ea3674599687 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.924052 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87bc88-032b-41ce-afe5-3240a0d6276d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:42.930026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.930841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.931126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.931403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.943803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b91b9f6b-eb53-4bb6-8adb-75ba92dc3157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:42.953626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:42.954559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 179/353] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:42.955364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32428ddc-31e5-4d9a-9498-958ac1e1ffb7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.956100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32428ddc-31e5-4d9a-9498-958ac1e1ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.956100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32428ddc-31e5-4d9a-9498-958ac1e1ffb7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.957796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 180/354] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:42.958542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32428ddc-31e5-4d9a-9498-958ac1e1ffb7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:42.972613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:42.973520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:42.973825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:42.974090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] PATH_INFO: `/v3/users/4c84bf93454445f7a7baba305020d159` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:42.976316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] RBAC: Authorizing `identity:get_user(user_id=4c84bf93454445f7a7baba305020d159)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:42.977778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:42.979689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 175/355] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/users/4c84bf93454445f7a7baba305020d159 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:42.980455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.073032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32428ddc-31e5-4d9a-9498-958ac1e1ffb7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.084304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01329cc-3e1a-4a36-9ecd-3eba43bf90e5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.110980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.111630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.111910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.112178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.113051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=17b60329ab4e47b9839db2418e4f4878) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:43.113365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.116839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202da2a9-d926-45c5-8248-27737940a29a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.120690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 181/356] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:43.121956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0c990-91ca-4c65-835f-b8806f76eb3c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.122085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0c990-91ca-4c65-835f-b8806f76eb3c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.123667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0c990-91ca-4c65-835f-b8806f76eb3c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.123667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 182/357] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:43.123851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.124789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0c990-91ca-4c65-835f-b8806f76eb3c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.124892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.124892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.125136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.126352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.129136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b9a60-1e79-4bef-afea-67bae5026cbd None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.130649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 176/358] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:42 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:43.131706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.131987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.132261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.151489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:43.153336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:43.244553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 177/359] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:43.245891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.258091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0c990-91ca-4c65-835f-b8806f76eb3c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.301893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.303494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.303780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.304051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.304816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:43.305570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.307050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b41951-1874-4912-b74e-f002448b7d04 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.317767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 183/360] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:43.322209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.322515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.322762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.341614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:43.343350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:43.388822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0294a-da0f-4469-8a7f-f6eb7c8cba88 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.433451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 184/361] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:43.434086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.446786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.447464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.447756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.448027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.449197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] RBAC: Adding query filter params (role.id=d2c8e940ae324570852a3cbfabc8e798, user.id=4c84bf93454445f7a7baba305020d159, scope.system=all) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:43.449521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.451531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.470051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 178/362] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/role_assignments?user.id=4c84bf93454445f7a7baba305020d159&scope.system=all&role.id=d2c8e940ae324570852a3cbfabc8e798 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:43.470391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.572234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde15a7-2cea-4562-aa7e-f588ba9b95bf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.600974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379370-cf96-4ef3-a841-3825cc891283 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.615561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.616427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.616705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.616976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.618183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.619697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.621505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 185/363] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:43.622148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.640889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.641742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.642030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.642310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.653731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:43.662645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:43.663597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:43.664403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 179/364] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:43.665065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.739264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a0a8e-311e-4f05-ab09-33cf89b66ce1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.779541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b55a3-550a-4210-80a9-67a132d00326 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:43.780011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.780659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.780940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.781210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.824906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:43.825627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:43.825940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:43.826217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:43.840446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:43.849743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:43.850657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:43.851460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 180/365] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:43.852116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:43.878786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:43.880254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:43.978300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef742a-8831-4db4-8225-96cceb853bfb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.006111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 186/366] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:44.006966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.014200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.014919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.015206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.015484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.016364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=6ebf0982a4fc497890f4a54b154129e5) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:44.016684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.018162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.028745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 181/367] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:43 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.029615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.124034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb15f5-0f04-4ef7-a906-f6d80b41fa33 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.164110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.164566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.164842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.165111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.166873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:44.166873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.167633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.172800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc05f6-8a97-4f7d-9cfd-7c69184f1560 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.178231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 187/368] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.179110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.213382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.214548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.215042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.215562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.216534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:44.217057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.218731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.228706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 182/369] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.229927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.298687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df292c-5bb9-4a0e-8162-e53fcdea4376 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.340212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.341068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.341345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.341612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.342828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.344267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.346003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 188/370] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.346775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.360917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823f677-1f50-4ee8-882b-097344a36768 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.405097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.406297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.406997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.407435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.468363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ff31d-c7f9-4eb7-9d2c-e7dfbace521c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.489404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.491042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.504481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.505485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.505935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.506357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.574584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.576267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.604240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 183/371] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:44.605561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.678400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 189/372] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:44.679484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.720322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda5cf2-3402-46f7-a7fd-ffb5f39b066a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.759987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.761007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.761380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.761947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.763058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.764627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.766442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 184/373] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.767138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.785265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca9e5c-26ad-4b3a-b996-871b69cb524d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.819457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.820644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.821105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.821574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.822961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.824583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.826869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 190/374] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.827809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.878202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f6d8-a2e0-4172-8790-75da7afd3df9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.914629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.915583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.915935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.916277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] PATH_INFO: `/v3/projects/dff5ce0253c84661be86a23d6b0b873d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.917550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] RBAC: Authorizing `identity:get_project(project_id=dff5ce0253c84661be86a23d6b0b873d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.919095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.920915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 185/375] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/projects/dff5ce0253c84661be86a23d6b0b873d => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.921764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:44.931144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0921-0b46-499c-b2d4-65f4898d2fef None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:44.965986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:44.966942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:44.967400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:44.967877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:44.968901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=17b60329ab4e47b9839db2418e4f4878) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:44.969435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:44.971076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:44.978040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 191/376] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:44.979088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:45.030173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67fe2e-d9f6-4357-a20a-82b915fd74c1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:45.069661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:45.070636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.070916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.071252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.072516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:45.074277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:45.076183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 186/377] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:45.081956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:45.088113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63f512-93ad-4f83-812b-f6ad5be4b0ee None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:45.125539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:45.127286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.127773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.128278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] PATH_INFO: `/v3/groups/be1363db9b334e4fae2f3b191d0fee08` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.134609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] RBAC: Authorizing `identity:get_group(group_id=be1363db9b334e4fae2f3b191d0fee08)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:45.136441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:45.138395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 192/378] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:44 2022] GET /identity/v3/groups/be1363db9b334e4fae2f3b191d0fee08 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:45.144406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:45.192817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c727d4-59d4-4e96-b37f-e37d39379c6e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:45.235916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:45.236582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.236860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.237130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.238886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=6ebf0982a4fc497890f4a54b154129e5) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:45.239263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:45.240701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416cbe0-ae2f-4efc-8f13-b3746933158f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:45.258309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 187/379] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:45 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:45.288854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c294fba-1d7a-4f75-9df6-7d19b0debef7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:45.328980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:45.329672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.329958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.330280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.331121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] RBAC: Adding query filter params (group.id=be1363db9b334e4fae2f3b191d0fee08, role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=dff5ce0253c84661be86a23d6b0b873d) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:45.331978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:45.333570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211c22-313c-4de1-bf15-cd949ae3c9da None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:45.342496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 193/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:45 2022] GET /identity/v3/role_assignments?group.id=be1363db9b334e4fae2f3b191d0fee08&scope.project.id=dff5ce0253c84661be86a23d6b0b873d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:45.778942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36444-e8ea-4b64-91f9-ab5cb4daa792 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.779314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36444-e8ea-4b64-91f9-ab5cb4daa792 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.779514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36444-e8ea-4b64-91f9-ab5cb4daa792 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.781021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 188/381] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:45.786893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:45.787184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:45.787460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:45.807886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:45.809075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:45.882867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 194/382] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:45.914229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36444-e8ea-4b64-91f9-ab5cb4daa792 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:46.055236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36444-e8ea-4b64-91f9-ab5cb4daa792 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:46.097266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:46.098240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.098481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.098757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.114550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:46.122443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:46.123347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:46.124147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 189/383] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:46.131833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:46.268952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1bae-fd3b-4bb1-9c1a-62621b074571 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:46.316780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:46.317443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.317754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.318034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.318795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:46.319105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:46.320469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:46.333401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 195/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:46.338913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:46.467614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8fc60-30f9-4552-94ba-c616db9c4103 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:46.504709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:46.506019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.506521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.507011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.508442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:46.510123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:46.512252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 190/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:46 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:46.522767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:46.660507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf06a57-e7c6-4135-8d56-3ac5108cfd57 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:46.704192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:46.705152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.705435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.705728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.706979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:46.708415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ab50-69b6-4906-8bc8-c6c98ac740b7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:46.710357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 196/386] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:46 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:46.716348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:46.825253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f80-623f-4405-8058-ba3b84c968af None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.825596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f80-623f-4405-8058-ba3b84c968af None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.825873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f80-623f-4405-8058-ba3b84c968af None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.827238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 197/387] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:46.843386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.843659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.843882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.849049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da84-a160-40e3-9058-132485dcfa38 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:46.879369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:46.880596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:46.884587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:46.885765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:46.886267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:46.886760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/groups/87d3bee49dea40cdbf82e690caa865ab/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:46.888950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, group_id=87d3bee49dea40cdbf82e690caa865ab, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:46.890619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:46.914623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 191/388] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 5 14:42:46 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/groups/87d3bee49dea40cdbf82e690caa865ab/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:46.992197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 198/389] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:47.031236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:47.157158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd2a4-5414-45a7-8c32-34ff464ac596 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:47.196302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:47.197493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.198039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.198514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.210043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:47.217992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:47.218866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:47.219671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:47.223117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 192/390] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:47.231084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:47.332524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb202d-1be2-4c99-8350-47995e7753bd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:47.372189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:47.372864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.373146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.373424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.374298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:47.374605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:47.375983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:47.385596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 199/391] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:47.390921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:47.520068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1e5a-d3f0-40ea-b0dc-edf997b9ba51 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:47.554656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:47.555519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.555801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.556075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.557248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:47.558723 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:47.560700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 193/392] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:47 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:47.567818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:47.725337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c729e-b865-4f88-9170-1ee72d3e6f11 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:47.774965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:47.776180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.776685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.777156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.778613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:47.780354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7756450-a579-45cb-80bb-33532405c7e2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:47.782288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 200/393] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:47 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:47.789350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:47.812015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcacc6-ded8-4e1a-bbc8-cfd7d2b1604c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.812632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcacc6-ded8-4e1a-bbc8-cfd7d2b1604c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.813107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcacc6-ded8-4e1a-bbc8-cfd7d2b1604c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.815261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 201/394] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:47.820458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.821012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.821487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.853054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:47.854663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:47.901884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7f6dc-5a31-4b24-994a-eaf71fb3d1ef None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:47.936833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:47.937744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:47.938030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:47.938306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/groups/87d3bee49dea40cdbf82e690caa865ab/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:47.940521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, group_id=87d3bee49dea40cdbf82e690caa865ab, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:47.942577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:47.961210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 194/395] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 5 14:42:47 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/groups/87d3bee49dea40cdbf82e690caa865ab/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:47.981764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 202/396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:48.005232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.129605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d21fb-f470-4493-a777-e7e64c539287 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.167112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.167988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.168276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.168552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.187358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:48.196102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:48.197056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:48.197919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:48.201854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 195/397] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:48.206894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.327369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8e80-7744-46c8-9e19-5f081ea9b04b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.366495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.367190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.367468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.367738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.368502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:48.368809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:48.370244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6703a4-247f-41d2-b368-b4aa2a9836e5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:48.381172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 203/398] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:48.386747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.512409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d793-f4d9-46c0-b8fa-3f5a5de57c2e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.512723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d793-f4d9-46c0-b8fa-3f5a5de57c2e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.512957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d793-f4d9-46c0-b8fa-3f5a5de57c2e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.514334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 204/399] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:48.517269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670d89-00da-4954-a2d1-c94a656f4108 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.533966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a4d5-e6f7-41bd-a92c-29055bf521fa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.534269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a4d5-e6f7-41bd-a92c-29055bf521fa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.534670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a4d5-e6f7-41bd-a92c-29055bf521fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.559630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-28a7a4d5-e6f7-41bd-a92c-29055bf521fa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:48.562136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-28a7a4d5-e6f7-41bd-a92c-29055bf521fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:48.577227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.578133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.578419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.578693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.579962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:48.582241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91388c-33f8-42bd-b180-31a112528603 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:48.584305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 196/400] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:48.585671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f722d7-22d5-4c19-b691-67b62d5aebe1 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.586057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f722d7-22d5-4c19-b691-67b62d5aebe1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.586405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f722d7-22d5-4c19-b691-67b62d5aebe1 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.587816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 197/401] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:48.592957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f722d7-22d5-4c19-b691-67b62d5aebe1 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.659461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 205/402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:48.661153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.661598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.662073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.694130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:48.695705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:48.710674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f722d7-22d5-4c19-b691-67b62d5aebe1 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.744008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.745144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.745608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.747028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.748604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:48.750279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:48.752161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 198/403] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:48.753130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.768520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 206/404] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:48.774408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.850915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33129-9910-49ea-8688-b131900ba1eb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.885266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.886420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.886899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.887378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.890461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70945f2-7e59-4106-8324-b6dbf8cdcbba None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:48.898200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:48.905948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:48.906810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:48.907630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:48.911113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 199/405] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:48.912079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:48.931072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:48.931860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:48.932171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:48.932496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878/groups/87d3bee49dea40cdbf82e690caa865ab/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:48.935207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b60329ab4e47b9839db2418e4f4878, group_id=87d3bee49dea40cdbf82e690caa865ab, role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:48.936390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:48.952317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 207/406] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 5 14:42:48 2022] PUT /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878/groups/87d3bee49dea40cdbf82e690caa865ab/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:48.953251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.022073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f9d8-70b3-4f78-9094-e177c4cc3aa6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.056585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.057879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.058356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.058817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.061798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874480-9a1a-44da-95bd-894b95af64b7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.071528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:49.080271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:49.081187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:49.082741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:49.085448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 200/407] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:49.092745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.109897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.111114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.111586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.112580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.114374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:49.114866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.117022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.129344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 208/408] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.135660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.263326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3721-4a4a-434a-8d2a-4642dfe594bf None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.307655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac051-76e6-4f3b-8040-d265390a9ef8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.308762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.309511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.309829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.310274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.313978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:49.314320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.315778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.329712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 201/409] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.332441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.356084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.356934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.357213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.357482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] PATH_INFO: `/v3/groups/be1363db9b334e4fae2f3b191d0fee08` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.358711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] RBAC: Authorizing `identity:get_group(group_id=be1363db9b334e4fae2f3b191d0fee08)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.360129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.362049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 209/410] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:49 2022] GET /identity/v3/groups/be1363db9b334e4fae2f3b191d0fee08 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.370593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.446520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269da86-714f-4110-b56c-018ecf839766 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.484764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.485781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.486138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.486476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.488295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.493679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.493679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 202/411] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:49 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.497920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.614394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcce8-5805-414c-8971-aa5e5f167eaf None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.627726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c552d4-829b-4be6-9cb7-f571cd8ba267 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.665660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.666531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.666806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.667077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.672782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.674298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.678156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 203/412] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:49 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.684205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.702510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.704036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.704313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.705296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] PATH_INFO: `/v3/projects/dff5ce0253c84661be86a23d6b0b873d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.707261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] RBAC: Authorizing `identity:get_project(project_id=dff5ce0253c84661be86a23d6b0b873d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.710866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.713546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 210/413] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:49 2022] GET /identity/v3/projects/dff5ce0253c84661be86a23d6b0b873d => generated 344 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:49.719539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:49.826628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b5c58-d9c9-4581-b5ce-f2379e63cc97 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.852524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6bed-4d71-439f-94ab-c2b813c9a692 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:49.871337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.872562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.872845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.873242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5/groups/87d3bee49dea40cdbf82e690caa865ab/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.876344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf0982a4fc497890f4a54b154129e5, group_id=87d3bee49dea40cdbf82e690caa865ab, role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.878869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dee664-aa52-44d1-b5db-b9afdcc6ffe8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.886064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:49.887105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.887449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.887787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] PATH_INFO: `/v3/projects/dff5ce0253c84661be86a23d6b0b873d/groups/be1363db9b334e4fae2f3b191d0fee08/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.890099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] RBAC: Authorizing `identity:create_grant(project_id=dff5ce0253c84661be86a23d6b0b873d, group_id=be1363db9b334e4fae2f3b191d0fee08, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:49.891886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:49.895679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 204/414] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 5 14:42:49 2022] PUT /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5/groups/87d3bee49dea40cdbf82e690caa865ab/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:49.897124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649609-4c36-4ad5-8601-32a5e19769a2 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.897468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649609-4c36-4ad5-8601-32a5e19769a2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.897836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649609-4c36-4ad5-8601-32a5e19769a2 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.899552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 205/415] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:49.905301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:49.905619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:49.906388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:49.918891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 211/416] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 5 14:42:49 2022] PUT /identity/v3/projects/dff5ce0253c84661be86a23d6b0b873d/groups/be1363db9b334e4fae2f3b191d0fee08/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:42:49.933967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:49.935225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:50.015176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:50.055247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:50.182746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4911-aa5f-4728-a96a-2f80b30cf87d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:50.219813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:50.220606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:50.220884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:50.221154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:50.231766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:50.239400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:50.240309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:50.241092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 212/418] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:50.246669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:50.356623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69525fe9-c6e5-4d91-8410-517638ed8f8b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:50.391562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:50.392608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:50.393082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:50.393545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:50.395131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:50.395675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:50.397424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:50.406928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 207/419] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:50.412360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:50.561622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0cdf-e33b-4786-81bb-80919015cdc2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:50.607663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:50.608311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:50.608592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:50.608869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:50.694787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:50.696165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1c04-02bb-4fb9-9870-31e03c7061c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:50.841998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 213/420] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:50.848182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:50.941470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de7e6-d26c-4a2f-9c5c-3e648b6b04e9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:50.941819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de7e6-d26c-4a2f-9c5c-3e648b6b04e9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:50.942087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de7e6-d26c-4a2f-9c5c-3e648b6b04e9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:50.943452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 214/421] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:50.953367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:50.953582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:50.953888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:50.982037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:50.983210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:51.025064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb55ff-c917-4574-b99c-8d1ce9b093e1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.089005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.089954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.090233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.090504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.092001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:51.093432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:51.095139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 208/422] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:50 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:51.101882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:51.119581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 215/423] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:51.146707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:51.274269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b7de5-7f65-484c-99d0-3df256f1715b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.300545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587fc48-848c-4934-aac7-88c5db3fd6e4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.317674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.317674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.317674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.317674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.326438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:51.334314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:51.335224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:51.336028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 216/424] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:51.341909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:51.378386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.379913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.380402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.380892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.386132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:51.387785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:51.390629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 209/425] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:51 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:51.402147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:51.514948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a21f1-3bbb-4562-97b1-76c8bf8f4658 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.581841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.582176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.585666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.585666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.585666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:51.585666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:51.585666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:51.593744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 217/426] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:51.600329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795f69-f175-4817-99bf-01c9cd1310d0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.602952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:51.660701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.661371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.661667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.661952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.662831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=17b60329ab4e47b9839db2418e4f4878) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:51.663186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:51.664611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7956d1-3428-49f7-9975-d89c0e8895d2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:51.671906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 210/427] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:51 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:51.795052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54e28f-32c4-4e61-9381-b8113d1694a0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:51.850722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:51.850722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.850722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.850722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.935139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a594c9-846c-4e0d-94df-a10d0ae2fb8a None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.935770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a594c9-846c-4e0d-94df-a10d0ae2fb8a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.935770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a594c9-846c-4e0d-94df-a10d0ae2fb8a None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.937280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 211/428] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:51.944413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:51.944676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:51.944961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:51.950557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:51.952030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:51.963371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:51.964542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:52.042173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 212/429] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:42:52.055205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 218/430] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:52.060401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.069828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.179103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c281e-6983-4176-82e7-95715c5d9b1a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.199486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c97fc-f47d-40e4-9e94-701a5b742566 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.221367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.223500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.223791 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.224337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.225761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.227765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.230534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 213/431] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:52.238086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.238332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.238332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.238332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.238332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.251403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:52.262078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:52.264316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:52.265374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 219/432] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:52.272204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.376119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264871-b945-4a95-a9a5-4b271ba743e0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.402916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880edb8-deff-417e-b916-8eebe5180f90 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.416981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.417855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.418133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.418401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.419582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.421008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.422931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 214/433] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:52.429313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.451269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.451269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.451269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.451269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.452377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:52.454079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.454318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.466839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 220/434] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:52.470802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.572067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68934f45-7c0c-4f4e-8135-1715fee78337 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.578838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378587-3dbd-4cb8-9dfd-7d19d8bf5b8e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.620995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.622633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.623298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.623843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.624847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=c51ca2684cd043fdb1ef8d5ca4e046bf, scope.project.id=6ebf0982a4fc497890f4a54b154129e5) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:52.625306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.626938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e85e-c6a9-454e-97d5-7edd8cfc25d3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.627742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.629468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.629468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.630084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.636890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 215/435] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=c51ca2684cd043fdb1ef8d5ca4e046bf => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:52.714100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.715486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.732565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cc57-8b7b-41b2-a8b0-dde8e55ffcc6 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.732878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cc57-8b7b-41b2-a8b0-dde8e55ffcc6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.733134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cc57-8b7b-41b2-a8b0-dde8e55ffcc6 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.738138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 216/436] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:52.741545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df323-37a9-491a-a185-8bbe7841bbda None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.741863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df323-37a9-491a-a185-8bbe7841bbda None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.742147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df323-37a9-491a-a185-8bbe7841bbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.759134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7c2df323-37a9-491a-a185-8bbe7841bbda None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:52.760356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7c2df323-37a9-491a-a185-8bbe7841bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:52.834111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 217/437] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:52.836577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362511-678b-4cf4-8790-3723026c6c2c None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.837095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362511-678b-4cf4-8790-3723026c6c2c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.837575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362511-678b-4cf4-8790-3723026c6c2c None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.839466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 218/438] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:52.843820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 221/439] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:52.845463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.845776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.846056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.846625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.864240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:52.865429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:52.940816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 219/440] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:52.941681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:52.952940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5638-8c9c-4943-a28a-096c860ded2f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:52.985484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:52.986283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:52.986563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:52.986860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] PATH_INFO: `/v3/projects/17b60329ab4e47b9839db2418e4f4878` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:52.988599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] RBAC: Authorizing `identity:get_project(project_id=17b60329ab4e47b9839db2418e4f4878)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:52.990068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:52.991772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 222/441] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/projects/17b60329ab4e47b9839db2418e4f4878 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:52.993614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.047118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f24b-4e0c-4247-af51-56472bda1286 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.078504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.079286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.079565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.079835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.084701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3fbe7-9239-4e96-bcae-d4c88ea07ccd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.090194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:53.098431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:53.099450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 220/442] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:53.100365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.117561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.118382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.118659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.118929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.128505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:53.136390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:53.137461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:53.138491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:53.139254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.199849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b0f2-3a66-4e3e-ab57-f1e92e23ca4b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.230408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb07fcd-2985-4850-94c7-3e35d708abdd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.232125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.232962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.233240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.233510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.234705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.236171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.237782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 221/444] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:53.238538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.265613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.266289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.266562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.266825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.267900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:53.267900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.270100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.277791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 224/445] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:53.278559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.334967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7c81-d3ef-433b-8965-789411a129a7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.367279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.367936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.368207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.368477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.369233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:53.369533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.370924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.372035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743694-8782-4e49-a183-e7d90f64a670 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.379417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 222/446] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:53.380196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.404600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.405262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.405538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.405847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.406669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=17b60329ab4e47b9839db2418e4f4878) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:53.406979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.408394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.414342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 225/447] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=17b60329ab4e47b9839db2418e4f4878&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:53.415033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.482218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5791-b5dd-46e2-9765-963aaa41c94f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.517535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.518152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.518435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.519370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.527900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b513-942f-4e7a-a1ad-fc477d662e21 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.561991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.562987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.563444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.564154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.590860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.592376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.641928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.643300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.697178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 223/448] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:53.703609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.755794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 226/449] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:42:53.760339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.816321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59fe7-e3b1-446d-bf29-5d91e05395a9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.853157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.854084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.854354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.854630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] PATH_INFO: `/v3/projects/dff5ce0253c84661be86a23d6b0b873d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.855814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] RBAC: Authorizing `identity:get_project(project_id=dff5ce0253c84661be86a23d6b0b873d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.857230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.859644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/projects/dff5ce0253c84661be86a23d6b0b873d => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:53.864408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.867395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42dc9a-3d83-4635-a3b2-53e22b1b8333 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:53.903642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:53.905026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:53.905026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:53.905026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] PATH_INFO: `/v3/projects/6ebf0982a4fc497890f4a54b154129e5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:53.906235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] RBAC: Authorizing `identity:get_project(project_id=6ebf0982a4fc497890f4a54b154129e5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:53.907663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:53.910178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/projects/6ebf0982a4fc497890f4a54b154129e5 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:53.915803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:53.974824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889949-77a7-44f8-8202-cfec40234687 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:54.006314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:54.007163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:54.007441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:54.007714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] PATH_INFO: `/v3/groups/be1363db9b334e4fae2f3b191d0fee08` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:54.008871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] RBAC: Authorizing `identity:get_group(group_id=be1363db9b334e4fae2f3b191d0fee08)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:54.010332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:54.012089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/groups/be1363db9b334e4fae2f3b191d0fee08 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:54.016622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfb6ba-46b5-4c4f-ad70-defab7f0239d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:54.017724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:54.048655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:54.049494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:54.049854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:54.050132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] PATH_INFO: `/v3/groups/87d3bee49dea40cdbf82e690caa865ab` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:54.051280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] RBAC: Authorizing `identity:get_group(group_id=87d3bee49dea40cdbf82e690caa865ab)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:54.052686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:54.054290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 5 14:42:53 2022] GET /identity/v3/groups/87d3bee49dea40cdbf82e690caa865ab => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:54.059834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:54.112436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb82-d2b1-45a0-b530-a71cb7fb2e98 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:54.145041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:54.145712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:54.145997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:54.146283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:54.147100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] RBAC: Adding query filter params (group.id=be1363db9b334e4fae2f3b191d0fee08, role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=dff5ce0253c84661be86a23d6b0b873d) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:54.147414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:54.148835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3182-4c3d-41ca-9951-f683d68da160 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:54.151604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05201a3-889a-4382-9a8f-bf32e151d86d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:54.154717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:54 2022] GET /identity/v3/role_assignments?group.id=be1363db9b334e4fae2f3b191d0fee08&scope.project.id=dff5ce0253c84661be86a23d6b0b873d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:54.185596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:54.186294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:54.186574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:54.186850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:54.187690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] RBAC: Adding query filter params (group.id=87d3bee49dea40cdbf82e690caa865ab, role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=6ebf0982a4fc497890f4a54b154129e5) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:54.188002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:54.189747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d473-5267-4c53-8a3c-82d41b8ae750 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:54.197092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 5 14:42:54 2022] GET /identity/v3/role_assignments?group.id=87d3bee49dea40cdbf82e690caa865ab&scope.project.id=6ebf0982a4fc497890f4a54b154129e5&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:57.084003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acc74-c6b1-4625-a7f8-f018c965c657 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.085140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acc74-c6b1-4625-a7f8-f018c965c657 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.085619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acc74-c6b1-4625-a7f8-f018c965c657 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.087447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:57.092569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038d5f-be1c-4a0f-83cf-f90b1604356a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.093387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038d5f-be1c-4a0f-83cf-f90b1604356a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.093973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038d5f-be1c-4a0f-83cf-f90b1604356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.114586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f7038d5f-be1c-4a0f-83cf-f90b1604356a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:57.116059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f7038d5f-be1c-4a0f-83cf-f90b1604356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:57.216172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:57.264451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995acc74-c6b1-4625-a7f8-f018c965c657 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.379117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe0ac6-096a-40da-a7db-cda5f038c1d0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.379739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe0ac6-096a-40da-a7db-cda5f038c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.380228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe0ac6-096a-40da-a7db-cda5f038c1d0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.386192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 231/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:57.389543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899f5f-2f12-425a-a874-6afb28720064 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.390015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899f5f-2f12-425a-a874-6afb28720064 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.390490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899f5f-2f12-425a-a874-6afb28720064 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.392179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 232/459] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:57.393387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.394126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995acc74-c6b1-4625-a7f8-f018c965c657 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:57.394689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.395183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.414476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:57.415951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:57.429786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:57.430576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.430861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.431564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.441767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:57.443229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c5b1b293-f97e-4692-8fe0-7ae5c8470a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:42:57.461086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:57.462183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:57.463025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:42:57.463025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:42:57.463025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.463025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:57.463025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 228/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:57.463930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.464220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.464495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.481425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:57.482651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:57.503001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 233/461] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:57.504712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.551969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 229/462] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:57.552826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.639560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186c5d-37fa-4fbb-8316-e21a5a31166e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:57.653288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeccc8-804d-4c71-9a6c-e100ec69749b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:57.687084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:57.687751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.688030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.688301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.689289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:57.689595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:57.691015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:57.696323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:57.697113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.697395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.697685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.708419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:57.709897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 234/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:57.710040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:57.711375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:42:57.728332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:57.729235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:57.730138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:42:57.730138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:42:57.730138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.730138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:57.734487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 230/464] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:57.735452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.844347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd46809-4d65-49e9-b716-edea88abf07b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:57.845367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057f61-adda-4d66-abfd-0fb5655d6278 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:57.879361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:57.880179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.880424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.880695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.889905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:57.891231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:57.891433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:57.891924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:57.892399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:57.892848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:57.894616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:57.896806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:42:57.910634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:57.911584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:57.912462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:42:57.912462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:42:57.912462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:57.912462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:57.912462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 235/465] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:57.913261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:57.926498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 231/466] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:57 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:57.927361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.045662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bacf-3829-4a64-aa66-3b93810853d3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.057502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2aa9-809f-48db-a116-c149e82c3784 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.086004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.086681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.087014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.087294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.088094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:58.088413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.089869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637723f-7e0d-47ad-8328-359af8666245 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.101792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.102474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.102765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.103035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.103312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 236/467] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:58.103772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:58.109675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.109675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f9b0-c21b-49e0-932a-95565eeeec5a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.110115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fdff-21d5-46aa-a12c-321c70a110b6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.110115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fdff-21d5-46aa-a12c-321c70a110b6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.110115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fdff-21d5-46aa-a12c-321c70a110b6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.111471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 237/468] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:42:58.113083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355fdff-21d5-46aa-a12c-321c70a110b6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.120938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 232/469] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:42:58.126679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.126966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.127245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.145624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:58.146767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:58.218835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 233/470] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:58.219795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.246482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355fdff-21d5-46aa-a12c-321c70a110b6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.293666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.294360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.294641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.294916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.295632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.297119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.329824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 238/471] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:42:58.331394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.332721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca3f2e-10d8-4e79-ac13-f7f87dd1d9a7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.374253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.375443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.375727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.376004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.377185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.379076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba901-1981-46f9-9df3-93881cce29da None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.406423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 234/472] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:58.501574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc149f-16e1-4e96-898f-3f71619989cf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.548725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.549541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.550531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.550920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.562738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.564503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.572363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376bd7-c3b2-4c0c-a0db-541b15defc38 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.572990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376bd7-c3b2-4c0c-a0db-541b15defc38 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.573474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376bd7-c3b2-4c0c-a0db-541b15defc38 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.577783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 235/473] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:42:58.581711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.582008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.582289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:42:58.585622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:58.586492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:58.587795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:42:58.587795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:42:58.587795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:42:58.587795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:42:58.587795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 239/474] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:42:58.593037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.611963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:42:58.614242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:58.697806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 236/475] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:42:58.713618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd28fb-d0e2-4c80-97ea-87e0c7da6a99 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.715910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.758312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.758991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.759641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.759925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.760943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:58.761256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.762725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.775237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 240/476] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:42:58.781626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.842677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f707e-b8ba-460a-aba0-98d23953e51b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.890946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.891625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.891976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.892168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.892920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.895179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.898145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ff05-3574-4b0c-94c8-7b0383951651 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:58.906465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.sql.core [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 14:42:58.906465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 14:42:58.906465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [parameters: {'id': '6780a0071b9449dbbcc0f12e23d917fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 14:42:58.906465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:42:58.922728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return ref.to_dict() May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:42:58.923646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application yield resource May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.rollback() May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.force_reraise() May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise self.value May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application session.commit() May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 14:42:58.924551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._prepare_impl() May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.flush() May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._flush(objects) May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application compat.raise_( May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application flush_context.execute() May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rec.execute(self) May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 14:42:58.925662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:42:58.926862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:42:58.927708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [parameters: {'id': '6780a0071b9449dbbcc0f12e23d917fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:58.928486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 14:42:58.929271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:58.930217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 237/477] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:58.930283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:58.951901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:58.952992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:58.953477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:58.954003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:58.954906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:58.956665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:58.980532 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 241/478] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:42:58 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:42:59.066011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697ba7-7797-473c-8d46-08a43506a978 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:59.102882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:59.104593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:59.105242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:59.105786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:59.118183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-414bc534-5c2b-4ef3-a992-5bfa70836611 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:42:59.126729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:42:59.127663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 14:42:59.128612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:42:59.131432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 238/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:42:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:42:59.138121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:59.287489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4ed15-1d59-499a-a1c5-bf4543e488ac None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:59.333444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:59.334140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:59.334421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:59.334692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:59.335441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:42:59.335746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:59.337110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee81ca-51b6-4edd-8bfa-ca65d2270f7e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:59.349206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 242/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:00.599979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4582e-e7b3-42ef-9fa5-d14f10e5881b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:00.600500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4582e-e7b3-42ef-9fa5-d14f10e5881b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:00.600500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4582e-e7b3-42ef-9fa5-d14f10e5881b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:00.602140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 239/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:00.607795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:00.608235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:00.608415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:00.626689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:00.627929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:00.715114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 243/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:00.751598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4582e-e7b3-42ef-9fa5-d14f10e5881b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:00.890103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4582e-e7b3-42ef-9fa5-d14f10e5881b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:00.939536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:00.940891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:00.941172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:00.941457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:00.959307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-0beb5bc0-99db-48e4-89a4-20d2d26429b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:00.967058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:00.968044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:00.968878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 240/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:00.978752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.089810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bd50-0c27-4af0-a9b0-529278f0c379 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.090150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bd50-0c27-4af0-a9b0-529278f0c379 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.090390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bd50-0c27-4af0-a9b0-529278f0c379 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.092022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 241/484] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:01.096967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.097256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.097538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.116075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f137-6c30-413e-98d3-cf83c576e704 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.130713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:01.131910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:01.157219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.157916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.158194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.158464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.159436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:01.159747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.161097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.183922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 244/485] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:01.189297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.235136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 242/486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:01.305018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.331590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b412dc-0a5e-44ff-a3b5-8a396c6030ac None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.377705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.380222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.382261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.382755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.410745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.413822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:01.445480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:01.446423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:01.447251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:01.447251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:01.447251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:01.447251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:01.449700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 245/487] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:01.455462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.523245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe96eb-26d8-405e-a8b0-5acfece9b837 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.574655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.575850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.576349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.576827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.587755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-09c5ca16-5534-4a11-80d1-acfb1ca2ba50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:01.595853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:01.597621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:01.598691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:01.601174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 243/488] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:01.603099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff63e-7366-41fe-9613-5a13b1c895bd None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.603611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff63e-7366-41fe-9613-5a13b1c895bd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.604091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff63e-7366-41fe-9613-5a13b1c895bd None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.606274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 244/489] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:01.607182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff63e-7366-41fe-9613-5a13b1c895bd None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.623248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13930422-454c-41b8-84d1-c392d7843c39 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.658368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.660030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.660515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.661016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.661986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:01.662497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.664068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34fbb-bbbc-41bf-951d-4370970e47b1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.677406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 246/490] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:01.678986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.679476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.679952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.697850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:01.699338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:01.715511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff63e-7366-41fe-9613-5a13b1c895bd None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.750072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.750737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.751015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.751284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.752019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:01.752323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.754810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.767399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 245/491] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:01.768344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.772791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 247/492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:01.778715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.868285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79bc3-1a9c-47d9-9786-defcb780b81a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.900896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ec4f-e0fa-43b0-a1fe-3f5da113c747 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:01.901778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.902565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.902843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.903115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.911107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.912588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:01.928389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:01.929367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:01.930308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 246/493] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:01.931806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:01.944229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:01.945443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:01.945985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:01.946493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:01.959106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:01.961995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:01.981682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:01.982582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:01.983419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:01.983419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:01.983419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:01.983419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:01.985625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 248/494] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:01.986684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.053623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e194d-0567-42aa-a838-3f4fd13b3ccc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.094363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.095747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.096318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.096985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.109798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:02.118087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:02.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:02.119761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:02.121293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6f56b-4a32-4f34-969a-4d19543dfbd2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.127114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 247/495] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:02.128994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.156195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.156939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.157217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.157484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.158365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:02.158662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.160184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.196813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 249/496] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:02.197675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.229108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac7b1-cb22-4912-a09c-254c9cde5696 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.260865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.261518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.261829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.262100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.262815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:02.263121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.264474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2d9e0-8d33-4d00-bcc8-3a80fc1c3683 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.275716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:02.276765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c827d4-fcb9-4644-9903-1b11ff7aca41 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.277050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c827d4-fcb9-4644-9903-1b11ff7aca41 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.277323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c827d4-fcb9-4644-9903-1b11ff7aca41 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.280747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 249/498] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:02.280747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc26db-c417-469e-a09c-04fbdf43c5f7 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.280747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc26db-c417-469e-a09c-04fbdf43c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.280747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc26db-c417-469e-a09c-04fbdf43c5f7 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.281311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 250/499] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:02.282003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc26db-c417-469e-a09c-04fbdf43c5f7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.292501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1a98-e506-4a01-8748-5b7a530dbf54 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.326309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.326898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.327176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.327448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.328184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:02.328489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.329880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.337408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 250/500] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:02.338290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.379779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc26db-c417-469e-a09c-04fbdf43c5f7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.411839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.412474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.412750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.413021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.433364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3619-9a4c-4832-9184-f5b637ba2806 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.473280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.474109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.474392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.474666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] PATH_INFO: `/v3/users/glance` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.480584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.482060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.482159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b002a-e370-4f5d-8f7f-23518343aa66 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.483513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c85dd666-7a96-4da2-bed6-0957fc00f76c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:02.499141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:02.500211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:02.501441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 251/501] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:02.502180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.502180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.502180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.517877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:02.519103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:02.578422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 251/502] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:02.579647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.579896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.580161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.589777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 252/503] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:02.590859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.595566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:02.597305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:02.660072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 252/504] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:02.660877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.693916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf303-fc18-44b9-a8a9-befc21a745b9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.727011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.727882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.728162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.728432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.738512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.739954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.754769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8aedf5-8e33-4215-a19f-4802155129b6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:02.757137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:02.757991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:02.758823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:02.758823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:02.758823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:02.758823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:02.761985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 253/505] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:02.762786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.787894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.788555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.788828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.789098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.789952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:02.790256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.791672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.829147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 253/506] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:02.829914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.854847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9436b-0e3f-4e66-be28-31cabc206d00 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.886812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.887583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.887857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.888126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.898003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:02.899418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:02.915468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:02.916370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:02.917211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:02.917211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:02.917211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:02.917211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:02.917211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:02.917468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:02.929332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3152-4e13-4b5b-be42-e25ac433eee3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:02.961894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:02.962681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:02.962964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:02.963242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:02.972898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:02.980554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:02.981501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:02.982705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 254/508] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:02.983485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.016139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343750-33b9-4b27-8f25-9ee374233d28 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.046858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.047625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.047903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.048181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.058773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.060219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:03.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:03.078426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:03.079349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:03.079349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:03.079349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.079349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:03.079567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4796-6868-415a-9858-2a1e33cef223 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.079647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 255/509] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:03.079647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.110564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.111216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.111496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.111772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.113169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:03.113474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.114872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.126083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 255/510] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:03.126864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.173691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4fe89-6656-44d4-b5e3-dec0fdf456ae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.206132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.206769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.207054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.207331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.218516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b176bf-9f05-4f75-9eb4-3ece2d21f92a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.250932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.251576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.251856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.252129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.253069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:03.253382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.254776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.265319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:03.266119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.272371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.273883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.360341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a036b-be34-46c3-9f1f-f709b53cb630 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.369081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 256/512] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:03.369928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.392776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.393588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.393919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.394202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.394943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:03.395251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.396612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.404265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 257/513] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:03.405060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.463795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe3cb-4dbb-41b2-a8d6-b922d1b09dc0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.496706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.497358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.497637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.497932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.498633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:03.498938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.500301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.501193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d215e5-656c-4440-8269-b063fa82dbf3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.511005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 257/514] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:03.511790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.534633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83705c-facb-446c-9014-3c651307f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.535784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83705c-facb-446c-9014-3c651307f633 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.536064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83705c-facb-446c-9014-3c651307f633 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.536339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83705c-facb-446c-9014-3c651307f633 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.544244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83705c-facb-446c-9014-3c651307f633 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.545704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83705c-facb-446c-9014-3c651307f633 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-da83705c-facb-446c-9014-3c651307f633 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:03.559538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:03.560624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 258/515] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:03.562009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83705c-facb-446c-9014-3c651307f633 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.608705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607ee76-539f-43d8-a12f-01ef79314430 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.638995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.639699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.639975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.640243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.647086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.648489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:03.663477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:03.664390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:03.665266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 258/516] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:03.666452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.666900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83705c-facb-446c-9014-3c651307f633 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.698308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.699082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.699363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.699635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.710401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.711845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:03.728846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:03.729739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 259/517] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:03.735096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.756779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6757a-f124-4cf8-a206-f4d6a605fd56 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.788964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.789759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.790034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.790300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.800047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.801477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:03.818880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:03.819746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:03.820579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:03.820579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:03.820579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:03.820579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:03.820579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 259/518] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:03.820848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.824397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c727-3b5b-4240-9c44-511f8206383f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.856725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.857366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.857668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.857946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.858637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.860051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.880245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 260/519] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:43:03 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:03.881044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.921147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3067ee8-db00-4c5d-a18a-2fb9fa4c68fd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:03.958412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:03.959097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:03.959375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:03.959646 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:03.960486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:03.960792 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:03.962323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:03.982597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 260/520] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:03.983917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:03.990114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f93f1-1478-41d5-9873-71962005de26 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.025634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.026838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.027127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.027411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.028607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.028940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.031084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.054610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 261/521] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.055459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.092072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8bd85-b3c2-4dbc-a339-96e458d9dca1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.130429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.131089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.131364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.131632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.132346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.132645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.134036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.146800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 261/522] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.147618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.169109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc96c3b-4e4e-4793-91a2-8c9f77c363fe None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.203063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.203726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.204007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.204279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.204991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.205295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.206682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.218058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 262/523] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.218813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.251318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdb30-906b-4a13-a135-97ca786451ef None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.286482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.287125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.287404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.287677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.321145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5a05-d857-4e20-850d-7c7f4c83f87a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.355070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.355811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.355998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.356266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.357082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.357390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.357725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.358849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.359556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.364076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 263/524] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.364849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.472501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 262/525] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:04.472501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.496505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267c99e-c285-4570-8129-f13886be2ca5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.532377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.533200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.533484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.533867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.542059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.543549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:04.559909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:04.560839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:04.561751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:04.567055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 264/526] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:04.568019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.573860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e06bc-2317-4403-821e-58e584a4d0e6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.609880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.611059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.611543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.612092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.619954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.621686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:04.637255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:04.638217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:04.639114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:04.641402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 263/527] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:04.642574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.671412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513058c5-663f-4f51-a396-d93c03c57566 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.706657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.707532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.707813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.708086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.718343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.719780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:04.738772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:04.739643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 265/528] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:04.741079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.752054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2562-3b70-40bb-9650-a6c857bcce8c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.789414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.790953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.791453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.791928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.792913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.793476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.795168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.815658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 264/529] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.816807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.845877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cde0-5221-492d-bafd-5ea9f6479eca None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.882245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.882916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.883197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.883475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.884301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.884611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.886063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.904979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 266/530] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.905672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:04.923799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9ea2-0988-43ff-907e-36085b5f0a2e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:04.961215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:04.962361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:04.962771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:04.963060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:04.963779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:04.964081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:04.965964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:04.981736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 265/531] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:04.982583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.014619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47de-9c4f-4a07-8d2c-84bdb6786a30 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.058217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.059365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.059988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.060472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.062049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=986749ece20e480fb60caaea17d97655) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:05.062825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.066077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.073113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 267/532] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/role_assignments?user.id=986749ece20e480fb60caaea17d97655&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:05.074181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.128646 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e61f6-eb7b-4863-afcb-9fb14009e3ca None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.204088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.204747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.205108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.205391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.251174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc33ad6-9c4c-44cd-979a-20ed635456b2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.292053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.292828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.293109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.293432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.302687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.306253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:05.326459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:05.327346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:05.328488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:05.333482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.334027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.335402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.450867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 266/534] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:05.459851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.485816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa2d5-e77e-402b-856d-ce0077c500b2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.541019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.541709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.541992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.542320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.543046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:05.543352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.544760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.561938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02780e09-cad7-44f6-87a7-9636453328a9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.565777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:05.571485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.611369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.612729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.613010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.613305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.638751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.640213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.672712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6f76-67dd-4d90-aeb4-7cd0faf0bb88 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:05.675489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:05.676327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:05.678036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:05.678036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:05.678036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:05.678036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:05.678036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:05.692747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:05.711601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.712256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.712532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.712805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.713622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=7d1bd23334ec406f81303f12c5672889) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:05.713999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.715412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.721031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 270/537] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/role_assignments?user.id=7d1bd23334ec406f81303f12c5672889&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:05.821359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3cc6-536c-4950-b6e5-fc6a2fe7cf1a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:05.858265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:05.858931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:05.859210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:05.859485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:05.860207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:05.860518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:05.861923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:05.874475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 268/538] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:05.879626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:06.023061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ecbd-a4ed-424e-8cb1-2b2537cf1e5d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:06.058065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:06.059234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.059723 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.060199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.067967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:06.069729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:06.084934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:06.085819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:06.086680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:06.089146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 271/539] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:06.097674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:06.212697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c974c14-1264-4b29-87e8-18f2875ea8ab None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:06.253384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:06.254262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.254546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.254823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.255617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:06.255928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:06.257355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804d15-2c3a-4ad1-a22a-acdff5ea8d38 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:06.270626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 269/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:06.276104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:06.415637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545a98e-2412-4038-97e4-141e828611e3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:06.453849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:06.454498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.454776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.455045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.456410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=fb6e25f80f1b42b092c1ae964b179f64) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:06.456713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:06.458149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6030a3-92c1-45e0-820d-dde5f29205a6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:06.463898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 272/541] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:06 2022] GET /identity/v3/role_assignments?user.id=fb6e25f80f1b42b092c1ae964b179f64&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:06.519058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c78-d115-4390-8a0d-a81ad9ebfc6d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.519400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c78-d115-4390-8a0d-a81ad9ebfc6d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.519642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c78-d115-4390-8a0d-a81ad9ebfc6d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.521012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 270/542] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:06.526854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.527170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.527410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.551877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:06.553070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:06.645633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 273/543] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:06.682313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5646c78-d115-4390-8a0d-a81ad9ebfc6d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:06.814234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5646c78-d115-4390-8a0d-a81ad9ebfc6d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:06.857100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:06.858714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:06.859219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:06.859715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:06.870478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:06.883063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:06.883958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:06.884779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:06.888203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 271/544] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:06.895201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.033278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4ac5-485e-4257-a9b8-8e1ff431201d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.073577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.074272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.074549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.074819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.075557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:07.075859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:07.077205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:07.086455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 274/545] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:07.094969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.274051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b788d9-76e2-439c-9ecf-b2c6862b0f46 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.318146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.318865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.319141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.319413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.335078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:07.336536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d1d63616-b8be-4c60-abd5-dba124421a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:07.361835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:07.362928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:07.364158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:07.364158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:07.364158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:07.364158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:07.364158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 272/546] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:07.368577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.395978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf84a6-4d8a-4976-b069-90d6aa01df13 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.396319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf84a6-4d8a-4976-b069-90d6aa01df13 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.396537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf84a6-4d8a-4976-b069-90d6aa01df13 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.397917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 273/547] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:07.414994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.415282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.415558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.458707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:07.459930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:07.477026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb93b-08a8-49a9-b550-db67afec237e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.510496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.511157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.511434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.511705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.512413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:07.512716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:07.514093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:07.526867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 275/548] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:07.535342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.599655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 274/549] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:07.630707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.665447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a5cbd-4fe2-4bf4-8b16-b0de364d3da8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.709588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.710534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.710819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.711094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.729625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:07.731144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:07.755895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:07.756853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:07.758409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 276/550] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:07.762762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.844085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d609b-fdaf-4160-9f42-6bd0746a3f33 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.874324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341a80e-8e00-4be2-a5bc-7e713d98f19f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:07.911838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.912632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.912908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.913491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.922021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:07.923517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.923925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:07.924199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.924744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.925816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:07.926320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:07.927914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddd371-ecd0-4f44-9ecb-71416cdc867c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-63fe20d8-1c01-4071-a7df-656df93b2d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:07.931883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:07.932756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:07.933539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 275/551] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:07.934699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f45-270f-4665-a96a-080b32e56996 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.934939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f45-270f-4665-a96a-080b32e56996 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.935210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f45-270f-4665-a96a-080b32e56996 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.942253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 276/552] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:07.946433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b4f45-270f-4665-a96a-080b32e56996 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:07.957603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 277/553] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:07.959396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:07.960100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:07.960735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:07.977425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:07.978449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:08.053670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 278/554] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:08.053670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.061520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b4f45-270f-4665-a96a-080b32e56996 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.112432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.113464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.113957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.114422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.115372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:08.115867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.117406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.126163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 277/555] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:08.127209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.154095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ebaaf-0610-442c-a03d-763b2dbecd20 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.188144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.188977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.189258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.189531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.226744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d69-3ad5-408e-b481-da7ef7cde926 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.263190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.264299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.264675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.265553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.266076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.266542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.277956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:08.286222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:08.287116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:08.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:08.295205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 278/556] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:08.296339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.370885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 279/557] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:08.372090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.405140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1aa2-cba9-41d4-98c7-65cf3eb82722 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.443405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.444241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.444521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.444840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.455560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.457683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:08.474432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:08.475307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:08.476262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:08.476262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:08.476262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.476262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:08.476262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 279/558] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:08.476550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.480128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db80f-0af6-45d5-b0ae-3b90fa636d1b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.513695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.514371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.514682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.514950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.515654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:08.515955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.517332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84f95e-6623-4bd5-a4c6-aea498b48be0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.526787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 280/559] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:08.528466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4546-bcfe-40d6-89a2-4d2de43455e8 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.528958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4546-bcfe-40d6-89a2-4d2de43455e8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.529436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4546-bcfe-40d6-89a2-4d2de43455e8 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.531069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 281/560] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:08.533476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f4546-bcfe-40d6-89a2-4d2de43455e8 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.588910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84ae7-d8fe-4bf6-836f-35c34c6c4607 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.622990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.623774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.624048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.624318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.635203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.636645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.646972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f4546-bcfe-40d6-89a2-4d2de43455e8 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:08.653728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:08.654782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:08.655960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:08.655960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:08.655960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.655960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:08.660567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 280/561] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:08.661284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.685433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.686205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.686394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.686655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.687360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:08.687738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.689299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c6ca-4b65-45cf-b3c4-1a79c0e1b3fc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.707245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 282/562] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:08.707245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.707245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.707245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.722362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:08.723535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:08.766448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7712-1340-4d28-95b2-50a7aaa48392 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.791427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 283/563] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:08.801824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.809951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.810863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.811186 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.811462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.823481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.824933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:08.843496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:08.844960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 281/564] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:08.846642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.912928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b929b1-8159-472d-aef1-26c2382d8ae3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.947087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.947831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.948017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.948281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:08.948990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:08.949295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:08.950689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:08.950814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8016bc-2d05-4891-b048-663a062a5560 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:08.966374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 284/565] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:08.966374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:08.989928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:08.991036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:08.991552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:08.992029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.000016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.001746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:09.016351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.017307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 282/566] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.019486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.063134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9492dd-8f5d-4987-afc9-fd472832ec88 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.094868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.095653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.095941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.096374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.106019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:09.114315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.115405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:09.116443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:09.117204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026f2a-3372-460e-9baa-2972b8dc908b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.119357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 285/567] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.119357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.148211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.148857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.149133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.149404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.150141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.150454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.151805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.163713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 283/568] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.164262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.214741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c75cf-a523-4648-a48b-7ebf9c6d172a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.246953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.247721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.247996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.248262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.255218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.256629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.259111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023520-b2a9-4ab5-8283-0c9d5e26df6b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-83614f65-2ff6-4b30-8b3c-be74ef9ee810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:09.270756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.271628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:09.272842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 286/569] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.273927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222dc24-1567-4f0f-8afd-83a5c11949bf None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.273927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222dc24-1567-4f0f-8afd-83a5c11949bf None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.273927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222dc24-1567-4f0f-8afd-83a5c11949bf None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.275150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 287/570] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:09.275816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222dc24-1567-4f0f-8afd-83a5c11949bf None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.296801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.297459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.297761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.298030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.298837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.299142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.300738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.318845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 284/571] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.319651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.372453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222dc24-1567-4f0f-8afd-83a5c11949bf None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.405008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.405684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.405965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.406240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.406971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.407278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.408665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.412313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163ebb8-ec89-4263-813e-14ba18486e67 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.416402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 288/572] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.417131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.448424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.449205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.449481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.449790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.457301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.458754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-aca0e89d-3db7-4bb7-b2a1-9cffc4e04962 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:09.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.473863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:09.474817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 285/573] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.475582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.475582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.475717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.492018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:09.493200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:09.517589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ebf-6fe8-4801-9841-6f58867a3d38 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.548574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.549757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.550043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.550315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.551079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.551382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.552794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.555995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:09.556812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.570099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 289/575] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.570099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.651099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb68883-68c6-471d-aa97-a1997e9b30dd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.661394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced703a-765c-4e3b-8c7a-1b79b00ab2c3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.683073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.683853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.684133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.684409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.694714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.695233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.695479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.695755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.696023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.696652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.705547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.707104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:09.713809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.714665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.715743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:09.715743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:09.715743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:09.715743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:09.715743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 287/576] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.716433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:09.726034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:09.727117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 290/577] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:09.728030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.810209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c851a-4b79-4234-b21b-446e8505977e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.821315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f211-9a2c-4774-ab18-3afbdbec4c56 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.841831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.842492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.842780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.843056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.843877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.844184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.845606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.853036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:09.853691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:09.853974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:09.854254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:09.855074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=31f29b5255954eb7acd1c00773731200) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:09.855382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:09.856778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:09.873749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 291/578] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/role_assignments?user.id=31f29b5255954eb7acd1c00773731200&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.873961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 288/579] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:09.874045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.874155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:09.976094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a162f5-db4b-4164-82f7-82edd7512109 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:09.977471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3599-fd9d-4f1b-8124-574e6ece2088 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.011488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.011712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.012235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.012342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.012496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.012588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.012772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.012867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.013524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.013833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.015229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.027804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 289/580] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.028747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.032606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:10.040968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.041972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:10.042796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:10.043424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 292/581] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.044828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.128930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3f1d-6c98-449a-9d0e-2112eeb39057 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.143781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd190a-2a7c-49d9-bb8b-3e64d07c4a6f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.162235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.162899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.163179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.163461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.164261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.164567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.165936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.177748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.178213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 290/582] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.179016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.183148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.183440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.183720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.194713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.196152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:10.213937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.214899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 293/583] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.220816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.281701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8da2-ab1b-498d-9c4c-4ea296f61b0b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.317084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1dea0-6bc2-438c-82ce-8a956706b95f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.319333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.320116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.320392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.320659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.327191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.328692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:10.342776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.343751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:10.344672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:10.348775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 291/584] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.349603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.352994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.353688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.353974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.354248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.354986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.355292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.356667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.369280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 294/585] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.369280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.455654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939141fe-7ab9-4009-bed1-ef8846106675 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.477178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5875c-bc62-44a3-b307-13d822ad62ac None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.493487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.494302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.494579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.494848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.502021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.503997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.510265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.511075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.511360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.511639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.512353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.512663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.514031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:10.518626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.519521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:10.520450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 292/586] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.521050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.535543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 295/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.535543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.623973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6f32-df26-4535-92b6-64ce03b87432 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.635232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d30e-7f9d-4fd3-892e-cae25e14bfb7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.659965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.660919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.661201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.661474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.662299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.662608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.664032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.668816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.669591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.669892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.670244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.676242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 293/588] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.677055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.682961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.684403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:10.702168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.703256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.704331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:10.704331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:10.704331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:10.704331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:10.706253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 296/589] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.707234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.776131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719da8c-376f-46b9-a84b-997468c4856a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.803901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a1e9f-70b0-4ba5-adae-7bec1358cf98 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.810283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.811062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.811461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.811831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.812752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:10.813160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.815210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.836372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 294/590] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:10.836372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.839654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.840437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.840713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.840985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.848438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.849903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:10.863914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:10.864960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 297/591] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:10.870607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:10.942485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6d767-3462-4143-9442-8de1abcb1185 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.970561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c369-1387-42f1-8403-d251d939dc9c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:10.978282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:10.979157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:10.979427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:10.979690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:10.994326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=b2f119b3cd5647b39942bdc91f95d8df, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:10.995739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.005194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.005884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.006175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.006440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.007158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:11.007468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.018733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 295/592] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:10 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:11.018953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.019043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.028944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 298/593] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:11.030076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.130688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61476507-6f9f-42c3-807f-a88aa42f7fb6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.140638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0054132-fb14-4676-aee3-58c71a2d7fb4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.166922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.167716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.167991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.168258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.178337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.179008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.179289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.179564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.179986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.180354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:11.180662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.181519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.182167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.197698 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 299/594] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:11.197698 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:11.206880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:11.208058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 296/595] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:11.209296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.320037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a213f-f766-465f-9bf8-05ff5db72b6e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.331028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd33-6605-4daa-a21d-de0bdad4fd8e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.354630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.355661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.356020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.356445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.364805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.366393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.372343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.373710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.374153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.374587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/986749ece20e480fb60caaea17d97655/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:11.383170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:11.384334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:11.385533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:11.391923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:11.391923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.399864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=986749ece20e480fb60caaea17d97655, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.401993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.419118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 297/597] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:11 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/986749ece20e480fb60caaea17d97655/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:11.420762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.561080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b5ea-bf65-4543-991b-11a6564ee4f3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.599811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d893-0382-4ae3-96f1-b1b3d6010863 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.640275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.640986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.641323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.641679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.642643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:11.642955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.643148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.643626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.643914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.644184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.644581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.644907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:11.645214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.646591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.665253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 298/598] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:11.671059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.675727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 301/599] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:11.682121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.777369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b94a6-6719-45eb-8487-172cceedcbfb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.785783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46759-9895-4cb1-aaf6-eca071675e74 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.812558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.813351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.813927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.814197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.822847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:11.823646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:11.823933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:11.824207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:11.825012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.826477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.832124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:11.833624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:11.844671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:11.847153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:11.848249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:11.848249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:11.848249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:11.848249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:11.848249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 299/600] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:11.848592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:11.849557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:11.854928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 302/601] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:11.856459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.857938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:11.976110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45144f1-d84e-419e-8de6-bed7a4cae82a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:11.994673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b02143-9bc7-417e-b513-9d2000c8f82a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.034370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.035148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.035428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.035698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.036481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:12.036788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.038253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.061373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.066187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.066477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.066758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.067492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:12.067802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.069173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.070821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 300/602] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:12.077981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.096306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 303/603] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:12.102192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.249758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f825883-98b8-4881-a72e-23b49e4dc78a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.264325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace82d9-f923-4e68-85a3-e02e6f98abe7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.306543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.307449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.307728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.308000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/7d1bd23334ec406f81303f12c5672889/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.323666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=7d1bd23334ec406f81303f12c5672889, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.325092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992830f-215f-452a-adaa-b933102d26f6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.342298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 301/604] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:12 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/7d1bd23334ec406f81303f12c5672889/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:12.347117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.347947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.348224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.348494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.350953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de318fb6-c10c-42e3-863d-950c97487967 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.351244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de318fb6-c10c-42e3-863d-950c97487967 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.351524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de318fb6-c10c-42e3-863d-950c97487967 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.353011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 302/605] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:12.361617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.363572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.367091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.367379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.367663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:12.380915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:12.381898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:12.382857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:12.390856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 304/606] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:12.395726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:12.397331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:12.398949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.536260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 303/607] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:12.580563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2467-1932-4656-b647-84693da34fc8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.586001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.630748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.631420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.631705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.631982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.632775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:12.633090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.634557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.651014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 305/608] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:12.657468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.711693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c00d4-c0ed-4d19-8ac4-0ec0eeb6443b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.766690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54cc2-c079-450d-86a3-68cf3beebbc0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.774904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.775713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.775994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.776269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.791774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:12.799910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:12.800841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:12.801679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 304/609] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:12.807331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.808231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.808513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.808789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/fb6e25f80f1b42b092c1ae964b179f64/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.819057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:12.832997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=fb6e25f80f1b42b092c1ae964b179f64, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.834562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.858222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 306/610] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:12 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/fb6e25f80f1b42b092c1ae964b179f64/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:12.931140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1eee-0c96-4c65-b562-2f5dbf5fe96e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:12.973909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:12.974591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:12.974872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:12.975150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:12.975906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:12.976213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:12.977586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:12.986777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 305/611] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:12.994906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.129344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c8bab-d8d7-401d-979f-cab8f31dffdc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:13.164392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:13.165199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.165481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.165789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.177017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:13.178502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:13.197546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:13.199681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:13.201931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:13.201931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:13.201931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:13.201931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:13.201931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 307/612] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:13.207306 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.321357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e150c-cd11-42d8-aee3-90e561c2049e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:13.363863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:13.364556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.364842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.365122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.365892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:13.366220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:13.367617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ac749-b58c-40e9-9f7e-0298fabbe3bc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:13.385898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 306/613] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:13.394981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.551965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a37ac-4559-44f8-9533-87ac9357d3b7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:13.578241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d536fc-011a-4185-8fff-414570c4b352 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.578569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d536fc-011a-4185-8fff-414570c4b352 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.578797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d536fc-011a-4185-8fff-414570c4b352 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.580463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 307/614] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:13.586316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.586844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.587424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.597509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:13.598431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.598716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.598992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.613869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:13.615052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:13.616737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:13.618224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:13.646282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:13.647226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:13.648243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 308/615] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:13.655929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.693310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 308/616] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:13.729958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.822459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f89f-9239-4d24-9dea-97ceb6a7bd5c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:13.875759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:13.876431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:13.876717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:13.876995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:13.878433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:13.878746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:13.880168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:13.898654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 309/617] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:13.905516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:13.915618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f8416-61f2-4402-be0f-ce286d2903c4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.006398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.007211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.007488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.007759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.008431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e0c6-b4f5-4dd9-b051-3ef7f72d9b14 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.036716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:14.046051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:14.046957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:14.047781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 309/618] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:14.054246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.075652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.076454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.076737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.077014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.099708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.101174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:14.131693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:14.133040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:14.135183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:14.135183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:14.135183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:14.135183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:14.144171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 310/619] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:14.145040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.221696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d9a7f-92a8-458e-b046-8938eccf950a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.259091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.259783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.260062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.260336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.261108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:14.261413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.262841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.285215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 310/620] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:14.299726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.351508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85253-e6a1-4391-b137-c77036b35e16 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.437040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.438044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.438822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.439309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.440420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:14.442035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.445046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477142d-7668-40a8-8f47-6210101afb82 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.465281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 311/621] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:14.472114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820d3a-7772-43fe-8d0b-099d0e4e0af3 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.472831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820d3a-7772-43fe-8d0b-099d0e4e0af3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.472939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820d3a-7772-43fe-8d0b-099d0e4e0af3 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.480677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 312/622] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:14.481437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820d3a-7772-43fe-8d0b-099d0e4e0af3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.491673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bb13-8684-4f1e-9b49-d22c7687e14d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.525845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.527055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.527560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.528094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.540068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.541840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5beee5d6-d94a-4ba9-be7f-9aed847cb816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:14.559995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:14.560927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:14.561906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:14.561906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:14.561906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:14.561906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:14.565459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 311/623] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:14.567017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.567507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.567980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.585471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:14.587036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:14.592826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820d3a-7772-43fe-8d0b-099d0e4e0af3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.629726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.630537 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.631161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.631161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.638142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.639434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:14.654001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:14.654908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:14.655829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:14.660769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 313/624] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:14.661845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.663504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 312/625] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:14.664606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.763769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e391-d7f5-4b8c-bd67-7fbbcd211f9f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.789234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbac85-4492-4209-b73d-7fd3d3b60c11 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.799918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.800870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.801389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.801920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.802938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:14.803466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.805084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.817588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 313/626] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:14.818767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.828980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.829678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.829964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.830797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.831535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:14.831843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:14.833211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:14.845189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 314/627] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:14.846181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:14.923086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631947-8f16-47fe-aaa8-84f12f632e8e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.947237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a65540-d1fb-43dd-8420-add5406d6f45 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:14.961109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.962393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.962883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.963358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.975987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:14.984205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:14.985158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:14.987659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:14.988633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:14.989384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:14.989684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:14.989977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/31f29b5255954eb7acd1c00773731200/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:14.991129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 314/628] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:14.992109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.012950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=31f29b5255954eb7acd1c00773731200, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.015007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.032744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 315/629] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:14 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/31f29b5255954eb7acd1c00773731200/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:15.034536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.124376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ea46-e83f-4fc0-a1e9-f5a0a1c189dc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.162805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.164081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.164629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.165097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.176150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.178057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4eb4762f-e4c9-49fe-b884-3d3ebc563895 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:15.193960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:15.194966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:15.196063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:15.198741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 315/630] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:15.200267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9393-6938-4a15-a7ed-18f5d452383d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.200765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9393-6938-4a15-a7ed-18f5d452383d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.201248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9393-6938-4a15-a7ed-18f5d452383d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.203073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 316/631] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:15.210731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9393-6938-4a15-a7ed-18f5d452383d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.260655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ffe56-0b29-40bf-add2-5cd7f5ae438a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.298780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.300048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.300441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.300713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.301465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:15.301873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.303237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2136ec-b35b-40fb-9520-1cee1b4c1f90 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.312166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 316/632] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:15.313438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.314016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.314288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.336344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9393-6938-4a15-a7ed-18f5d452383d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.337882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:15.339104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:15.383921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.384599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.385315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.385597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.386469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:15.386781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.388577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.412292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 317/633] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:15.413225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.414050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 317/634] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:15.422313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.531486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96541-06fa-4695-b959-1d697cbf1b0e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.540758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64da64-aba3-49b3-8605-fd25d8430054 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.566577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.567563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.567841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.568108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.575004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.575640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.575918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.576192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.578125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.579559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:15.598392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:15.599437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:15.600361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:15.600361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:15.600361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:15.600361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:15.600361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 318/635] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:15.600760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.647017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.648602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f653-4e9b-4f86-8bb9-cc7c27f9a14a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.707455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c379f-572c-433e-8109-41fbbff0e1ef None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.740773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.741554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.741853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.742124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 318/636] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae32-a81b-47f7-965e-d5c214a2002c None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae32-a81b-47f7-965e-d5c214a2002c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ae32-a81b-47f7-965e-d5c214a2002c None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 319/637] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:15.747219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ae32-a81b-47f7-965e-d5c214a2002c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.760044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:15.768272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:15.769219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:15.770082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:15.773794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 319/638] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:15.774648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:15.852049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ae32-a81b-47f7-965e-d5c214a2002c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.870634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820870-4b4e-416c-935d-58732a00dab1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:15.886427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.887371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.887823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.888095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.888868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:15.889180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.890628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e41b-2f01-4685-a6d1-1f5b1b542ac7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.903205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 320/639] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:15.904607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.905138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.905516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.909745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:15.910533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:15.910807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:15.911078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:15.921410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:15.922168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:15.922880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:15.923337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:15.941563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:15.942524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 320/640] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:15.944019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.001672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 321/641] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:16.001672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.050377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985ac01-77aa-4e2e-b569-c5f16a333da5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.085691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.086596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.087037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.087308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.088047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.088351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.089722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.102300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 321/642] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.102300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.105895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0e602-ff58-4456-8e4c-4868bfff5296 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.139400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.140249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.140529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.140852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] PATH_INFO: `/v3/users/glance` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.148746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.150221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:16.164393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:16.165475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 322/643] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:16.166785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.204612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913447f2-acdf-42d3-b3dc-45710b61df3c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.242507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.243173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.243451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.243723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.244438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.244802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.246660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.266513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 322/644] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.266513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.269434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f920f-6183-4932-a51f-d1ac1812186d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.302553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.303387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.303750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.303920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.314802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:16.322577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:16.323721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:16.329708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.374166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d43f-248e-4b7c-a918-290d29d16931 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.407235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.408015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.408329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.409288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.419345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.420865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.433861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc1f1-159a-4a67-91fa-ffd2561b930f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:16.440958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:16.441898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:16.447114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.478088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.478756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.479040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.479977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.480170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.480449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.481892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.503545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.503545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.546951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be2b5e-4cbf-4195-9158-40ad4e0cb8ae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.586797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.587696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.588015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.588285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.594831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.597488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.607065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dc05-e74c-4602-864d-51cdbbe6a974 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:16.611637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:16.612743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:16.614150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 324/648] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:16.618013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.642356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.644100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.644384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.644658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.645397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.645731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.647090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.654848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 325/649] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.655632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.719831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea0dce-3e98-4860-9d12-6cf7b4a5a7c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.753181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.754109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.754530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.754961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.755812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.756259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.757772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.759268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32fa1-85c3-45b8-90b0-7fe990e5f064 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.774484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 325/650] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.774721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.793348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.794036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.794317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.794591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.869574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.870429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a573-5fa9-484b-b0e8-2199452f572c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:16.871045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.904487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:16.905127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:16.905345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:16.905611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:16.906492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:16.906717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:16.908122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:16.919996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 326/651] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:16.920809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:16.976972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 326/652] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:16.977845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.032094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8077-b5e0-44ec-bf0f-e888a58ad79c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.065668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.066544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.066826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.067086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.079094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.080859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.084185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5749fd-32f8-49cd-b8f0-129f52a3d113 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:17.098575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:17.099686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 327/653] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:17.100587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.120870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.121780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.122066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.122341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.130240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.131676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:17.145748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:17.146704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 327/654] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:17.147668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.253518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52521502-c421-4be4-8635-6b2ad43c9ac9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.289221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.290164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.290442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.290714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.302562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.304130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:17.324084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:17.325209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 328/655] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:17.326675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.337812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee567d76-8a5d-4896-a806-9df3d2c4d0ec None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.371386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.372037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.372308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.372575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.373381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:17.373761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.375137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.381931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 328/656] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:17.382690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.432841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a78ea-3091-4bf4-8762-4734e4b32cb1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.468206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.468877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.469154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.469428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.473700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:17.473700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.473700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.485066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 329/657] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:17.485970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.498945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524e3d9-bae3-4a38-99e0-8d99a9293b0a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.535654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.536249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.536532 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.536791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.537621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:17.537948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.539392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215b01-4972-4ee7-9fb5-ab77772a2d6a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.563012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 329/658] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:17.563012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486572-3ab9-42df-9e6e-8ea0e203cd32 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.563012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486572-3ab9-42df-9e6e-8ea0e203cd32 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.563012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486572-3ab9-42df-9e6e-8ea0e203cd32 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.566259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 330/659] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:17.567132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486572-3ab9-42df-9e6e-8ea0e203cd32 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.591649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba90-3395-4e3f-9874-0509701f2d9f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.630891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.631605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.631890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.632172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.633565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:17.633565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.635520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.649298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:17.650475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.677309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486572-3ab9-42df-9e6e-8ea0e203cd32 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.712571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.713352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.713632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.713933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.722042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.723476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-078e46ec-f0b1-4389-bc7a-31178e47fffa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:17.738559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:17.739522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 331/661] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.745760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.746494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.749037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4279-3133-418c-ba27-e99ce2a3a806 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.761046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:17.762267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:17.783555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.784414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.784700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.784975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.837744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 332/662] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:17.837744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.851789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.853374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.926544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9dfb5-a87f-4d88-9a00-11db14340e40 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:17.955211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 331/663] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:17.955211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:17.959723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:17.960509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:17.960786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:17.961055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:17.967719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:17.969136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:17.982803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:17.983693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:17.984596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 333/664] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:17.985080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.049401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9defc0-ba73-4bcc-a87c-e72b0125fdf5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.083054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.084047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.084233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b7c6-b3a1-417d-8d82-8cccc8a2855d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.084711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.085207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.086293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:18.086677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.088235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.109194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 332/665] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:18.109194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.117040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.117858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.118140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.118439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.129307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:18.136856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:18.138014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 334/666] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:18.143913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.214278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab235729-ca56-4d35-947e-84c0dcf3f031 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.240901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9824-9108-45b0-b262-aff8d3d72a96 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.248064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.248547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.248828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.249162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.259555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.261002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.273709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.274363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.274640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.274912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.275686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:18.275990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.277389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:18.279327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:18.280256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:18.281184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:18.281184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:18.281184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.281184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:18.281184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:18.281469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.301485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:18.301485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.379646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a760-980a-415c-8040-38eeb0e92cb7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.398631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3e913-9759-4a5a-9a8b-b986e65eab1b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.412290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.412938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.413215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.413495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.436012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.436690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.436970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.437243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.438030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:18.438338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.440818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.453260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 336/669] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:18.453260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.482540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.484223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.554824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8515f-2d02-4a6c-b41e-8231e1453070 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.587202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 334/670] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:18.587939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.592386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.593244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.593692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.594137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.595002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:18.595454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.598221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.621172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 337/671] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:18.621172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.691363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d3e8-9aa0-4566-9d3e-a4cb3ef7b3f3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.717613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83742451-61a3-4853-a5b6-5ded9345706d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.725404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.725918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.726273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.726618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.727511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=986749ece20e480fb60caaea17d97655) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:18.727894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.729412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.746027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 335/672] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/role_assignments?user.id=986749ece20e480fb60caaea17d97655&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:18.746027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.750451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.751256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.751531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.751797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.763579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.765049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:18.784841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:18.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:18.787028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:18.787028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:18.787028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.787028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:18.787028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:18.787307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.857049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048126-6452-4298-9135-0a8f79061321 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.893629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ce83-2fda-4f6a-910a-a52f9414087b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:18.894555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.895359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.895641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.895919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.907040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.909215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:18.928618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:18.930818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:18.933009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:18.933009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:18.933009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:18.933009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:18.933520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:18.933711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 336/674] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:18.933711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:18.937765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:18.937765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:18.937765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:18.945299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:18.947486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:18.962416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:18.963558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:18.964476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 339/675] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:18.964979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.047390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd5ce-ad75-482c-82d7-25a1ad42fb15 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.070466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5eb29-329c-4913-9734-0312aa9c9ac8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.082718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.083386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.083670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.083949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.084673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.084981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.086371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.098810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 337/676] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.099654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.107290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.108237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.108748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.109203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.110221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.110708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.112981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.126083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 340/677] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.127344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.200231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314db3-3483-4278-85f6-b708a582e805 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.228545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599679-ede1-4e6d-aab6-b7cbdac99d7c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.234381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.235046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.235332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.235612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.236446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.236764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.238223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.251387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 338/678] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.252302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.270741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.271648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.271931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.272204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.285010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.287504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:19.305295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:19.306318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:19.307267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 341/679] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:19.311698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.364082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a28f-7fbe-404f-86cc-c6c10dddb2a5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.407652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.410386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.411166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.411679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.415417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f693-2e1d-4a76-8f7e-c921a5ac33da None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.420941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.423049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:19.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:19.443413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:19.444309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 339/680] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:19.444805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.453542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.454164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.454445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.454723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.456148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=7d1bd23334ec406f81303f12c5672889) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.456456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.457934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.464488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 342/681] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/role_assignments?user.id=7d1bd23334ec406f81303f12c5672889&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.465364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.615507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352558c-b85c-45dc-8d10-a18d809ee662 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.666714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.668804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.668804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.668804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.668804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.669116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.670853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.719972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.727317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.743651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240826-51a2-46da-8b0b-ccd95ce440ea None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.843305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.844391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.844672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.846405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.847220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:19.847531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:19.848966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877202-25c8-406c-9a36-72b4a67a9d38 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:19.870504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 343/683] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:19.872327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e5fa-6bb5-4924-9a45-06b457adaf62 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.872620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e5fa-6bb5-4924-9a45-06b457adaf62 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.872892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e5fa-6bb5-4924-9a45-06b457adaf62 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:19.878829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 344/684] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:19.880219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e5fa-6bb5-4924-9a45-06b457adaf62 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:19.904174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46af8f-6941-468b-81aa-56257ce89ce5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:19.986562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:19.987155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:19.987437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:19.987711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.021209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e5fa-6bb5-4924-9a45-06b457adaf62 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.089256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.089948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.090228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.090504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.091334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=fb6e25f80f1b42b092c1ae964b179f64) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:20.091702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.093689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c32322-efa2-4d1f-a3d1-13583ff150a4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.103663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 345/685] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/role_assignments?user.id=fb6e25f80f1b42b092c1ae964b179f64&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:20.105250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.105544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.105860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.111132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.113598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.129679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:20.129679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:20.214046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 346/686] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:20.233097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.346452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 341/687] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:20.349123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e654c-cad1-4a88-8303-deab0383c7ac None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.355453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.400935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.401761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.402045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.402318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.413287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:20.420897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:20.422283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:20.423141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:20.428408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 347/688] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:20.429727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.486921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e1f2-5531-447f-82f3-4a52a3b53665 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.534736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.535695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.536006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.536588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.542191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958cbe-108f-4295-a0ea-8378b3729629 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.550136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.552054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:20.571870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:20.572857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:20.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:20.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:20.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:20.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:20.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 342/689] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:20.578504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.586181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.587424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.587928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.588399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.589286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:20.589761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.591256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.600494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 348/690] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:20.606837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.732682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab257-7f19-45c5-8abe-fc654121a339 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.780625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c261e-8d26-41c4-bf36-4a434167b57f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:20.790091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.790815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.791098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.791422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.792151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:20.792459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.793854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.819039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 343/691] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:20.824267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.842224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:20.843021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:20.843300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:20.843576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:20.862715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:20.864091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:20.898360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:20.899382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:20.900302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:20.900302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:20.900302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:20.900302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:20.904111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 349/692] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:20.905636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:20.976247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3195-b5c3-4709-9785-3e0d0430b799 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.041233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.042045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.042328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.042601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.054715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.056852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.070435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aad0c-e6fc-47fe-bcca-53d6d6f149b5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:21.084832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:21.085760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:21.086669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:21.087990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 344/693] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:21.091487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.141661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.142262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.142653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.143430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.144155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:21.144455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.145843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.172476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 350/694] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:21.182734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.223556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea850bc-5de8-422b-abd2-b1d5da10afc7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.260365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.261122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.261405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.261700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.263306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:21.263624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.265062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.283844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 345/695] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:21.285226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.382642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a43c-cf0a-446a-94a3-3cb5f6a3f0f6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.431944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e91d-792f-42d5-89db-a4b3392645c1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.436570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.437860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.438287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.439366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.450271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.451904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-41772ead-7cd7-4e3d-9881-ee459bbad7c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:21.467716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:21.468875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:21.470062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:21.471360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.472275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.472686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.473101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.474096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=31f29b5255954eb7acd1c00773731200) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:21.474297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 351/696] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:21.474702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.475717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421a6d-0a5a-4e23-9c16-13bfd16aa693 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.476002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421a6d-0a5a-4e23-9c16-13bfd16aa693 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.476282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421a6d-0a5a-4e23-9c16-13bfd16aa693 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.476717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f3745-e6d1-45dc-9767-6bc2ee4f7f92 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.481485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 352/697] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:21.482268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df421a6d-0a5a-4e23-9c16-13bfd16aa693 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.483782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 346/698] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/role_assignments?user.id=31f29b5255954eb7acd1c00773731200&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:21.507818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.508787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.509275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.536186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:21.539519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:21.631475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 347/699] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:21.663924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df421a6d-0a5a-4e23-9c16-13bfd16aa693 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.670389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.723347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.723945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.724226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.724505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.725342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:21.725668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.735509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.758813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 353/700] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:21.764225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.790692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9af2a-36e7-4dd4-a87d-be01b6c95e21 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.833680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.835537 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.836033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.836637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.851266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:21.853008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:21.875353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:21.876306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:21.878126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:21.878126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:21.878126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:21.878126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:21.881750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 348/701] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:21.883411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:21.889057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a8e1-1314-4609-9103-9d254d1eec6f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:21.933674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:21.934910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:21.935645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:21.936415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:21.989953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35b718-9457-409a-857c-80d876b44461 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.023234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.025015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.027121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.027808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.028092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.028415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.029485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:22.029485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.030904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.049786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 349/702] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:22.051117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.157245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe01b-b9e6-4a24-afad-8284793279b1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.169153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 354/703] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:22.187070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.202057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.202057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.202057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.202057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.202469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.202717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969f7a2-e327-4f64-be4c-507d75be70ae None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.231188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 350/704] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:43:22 2022] POST /identity/v3/users => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:22.256063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61939-c262-41a8-8337-73c38eb24853 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.256259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61939-c262-41a8-8337-73c38eb24853 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.256532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61939-c262-41a8-8337-73c38eb24853 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.258114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 351/705] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:22.263683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.264020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.264302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.295366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:22.296832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:22.394138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51569b-1b37-4028-bf6a-fe9e9c8a738d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.411087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 352/706] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:22.433541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.436068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.436937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.437466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.437466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.458748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.460314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:22.489533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:22.490524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:22.491421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:22.491421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:22.491421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:22.491421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:22.491421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 355/707] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:22.497848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.543248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b2dd-fd4c-47bd-9b7a-c39670fcdf8a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.578489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.579672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.580778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.581432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.582317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.583898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:22.598743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:22.599742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:22.600597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:22.603586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:22.610095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.611925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee0df-9cbd-48b1-963a-ec1173f850c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.657293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.657983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.658838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.659117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.659840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:22.660147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.661639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.676322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 356/709] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:22.682339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.745710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bac8b-b3c1-44e1-ba3f-76670038036c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.787634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddaec-f77c-4def-9a5f-ae4107ae03f2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.790261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.792143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.792603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.793062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.794055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:22.794524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.796110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.807106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 354/710] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:22.812709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.835788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.836835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.837269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.837720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.847952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.850246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:22.877369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:22.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:22.879429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:22.881963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 357/711] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:22.890860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:22.934517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa6f1-0b20-4ac1-85c6-a171f9cd3b00 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:22.978377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:22.979063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.979347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.979626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.980345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:22.980653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:22.982042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36745c8-7cfb-4381-86df-6a29df3dd765 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:22.990585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 355/712] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:22.991963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905f21-2044-4667-a5ce-3a33d42cc2a7 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.992256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905f21-2044-4667-a5ce-3a33d42cc2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.992531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905f21-2044-4667-a5ce-3a33d42cc2a7 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:22.994095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 356/713] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:22.999075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:22.999360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:22.999640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.018858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:23.019863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816edf7e-cd55-4fa2-ba2e-fe464e5402fc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:23.020484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:23.070249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:23.070839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:23.071117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:23.071389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.072233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:23.072545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:23.074184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:23.098246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 357/714] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 14:43:23.100183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 358/715] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:23.106057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:23.146726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:23.216996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e155f95-14fb-43ab-931b-785c5a98bdaa None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:23.254907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:23.255568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:23.255846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:23.256119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.256944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:23.257315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:23.258844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:23.264824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 358/716] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:23 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:23.331176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742024d-6d66-49d0-aeb2-78c94aa851ed None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:23.373340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:23.374203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:23.374483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:23.374757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] PATH_INFO: `/v3/services/network` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.375446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:23.376949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:23.395960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:23.397969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:23.399023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 359/717] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:23 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:23.406097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:23.525503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c08a-71e3-446c-b1e6-2775893a0412 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:23.559724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:23.560493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:23.560692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:23.560953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.561677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] RBAC: Adding query filter params (name=network) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:23.561995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:23.563460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e834-f965-42f0-bd61-eb86ad60eabc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:23.569165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 359/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:23.574496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:23.725524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeed3f-bd94-4fad-8975-cd9f321f2b3d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:23.774706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:23.775373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:23.775650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:23.775922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:23.776630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] RBAC: Adding query filter params (type=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:23.776936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:23.778316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5926f0-a0b3-4575-ae5d-7f3ff62c9e9e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:23.790626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 360/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:24.560714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528bd2-f67a-4293-8e73-bf2258f09928 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:24.561226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528bd2-f67a-4293-8e73-bf2258f09928 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:24.561331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528bd2-f67a-4293-8e73-bf2258f09928 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:24.562926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 360/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:24.584370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:24.584893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:24.584893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:24.606052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:24.607247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:24.696579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:24.736958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528bd2-f67a-4293-8e73-bf2258f09928 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:24.859945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528bd2-f67a-4293-8e73-bf2258f09928 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:24.905994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:24.906784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:24.907066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:24.907346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:24.926535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:24.934078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:24.935014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:24.935877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:24.936512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 361/722] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:24.941380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.060654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38fad4-4786-4abb-a29c-9629e1bc8381 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:25.101863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:25.102532 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.102811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.103086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.103826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:25.104132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:25.105503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:25.117322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 362/723] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:25.122433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.289433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5650cb-ed21-495b-9d48-a367c992322b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:25.333567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:25.334307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.334585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.334856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.350521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:25.351970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-3b76d8d8-7220-4519-9273-f0ad6e176df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:25.372460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:25.373399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:25.374377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:25.374377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:25.374377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:25.374377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:25.377751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 362/724] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:25.382740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.501425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b9a5-4927-4e88-95ab-fd3c3ad1662f None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.501851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b9a5-4927-4e88-95ab-fd3c3ad1662f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.502149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b9a5-4927-4e88-95ab-fd3c3ad1662f None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.506251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 363/725] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:25.511364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.511651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.512089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.537116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25d5c-a906-4871-96d0-f7106eca210a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:25.544005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:25.545197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:25.594580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:25.597856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.598147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.598429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.599164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:25.599474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:25.600846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:25.627306 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 363/726] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:25.631890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.663242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 364/727] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:25.687744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.796133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8d3a-4aa9-4867-a284-21e2c33506b9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:25.860102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf33a9-7ff6-4558-b76c-b745668bcf5a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:25.862147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:25.862943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.863223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.863496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.871857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:25.873772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:25.890086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:25.891052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:25.891984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 364/728] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:25.898816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:25.932003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:25.933565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.933869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.934144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.954197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-558970b4-fb15-4061-9150-02dd5c1bb787 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:25.961994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:25.964113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 365/729] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:25.966148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528e60-ea4e-46d2-8495-ec13740ab2a0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:25.967891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528e60-ea4e-46d2-8495-ec13740ab2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:25.967891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528e60-ea4e-46d2-8495-ec13740ab2a0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:25.972390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 366/730] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:25.973142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528e60-ea4e-46d2-8495-ec13740ab2a0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.043454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb543-63a7-4612-bc0f-630fabcdc13d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.076593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.077221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528e60-ea4e-46d2-8495-ec13740ab2a0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.077347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.077526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.077824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.078644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:26.078949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.081094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b0185-9247-4abf-a668-88214582c0d4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.099399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 365/731] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:26.100729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.101013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.101336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.117712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.117905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:26.118286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.118565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.118836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.118940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:26.119570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:26.119874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.122146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b94b8b-284d-4700-90e7-fddaad9e1878 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.130635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 367/732] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:26.131903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67e77-1079-422c-a854-67f8537b5aee None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.132187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67e77-1079-422c-a854-67f8537b5aee None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.132462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67e77-1079-422c-a854-67f8537b5aee None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.133859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 368/733] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:26.138276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67e77-1079-422c-a854-67f8537b5aee None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.193318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 366/734] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:26.194622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.254744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67e77-1079-422c-a854-67f8537b5aee None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.287958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.288610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.288891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.289167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.307831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d113da-cd02-48ce-8a81-8c1d79203fbb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.342057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.342848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.343123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.343390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.354550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.355960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.359543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.361785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5d47613a-e32e-483a-bcb1-d99f53a8cb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:26.374708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:26.375847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:26.377524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:26.377524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:26.377524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:26.377524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:26.377927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 367/735] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:26.380800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.381534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.381983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.401979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:26.403766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:26.463941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 369/736] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:26.464629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.484251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 368/737] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:26.485465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.579737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9eae-095b-462e-8109-4da10295899a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.582610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02cbc1-7bca-4c5c-bb13-59921bbbbee3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.614464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.615281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.615608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.615835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.618517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.619193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.619469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.619741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.620484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:26.620785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.622228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.628373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:26.640296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 369/738] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:26.640296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:26.640587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:26.641476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 370/739] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:26.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.755849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed01a5b-d830-4d55-84e6-db19b21d3ece None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.761230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6d60-a57c-47b3-ad34-35b943301080 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.788717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.789373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.789678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.789956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.790664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.792035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.795139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.796511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.797091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.797524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.807458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 371/740] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:26 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:26.808479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.821536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.823116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:26.842134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:26.843329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:26.844479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:26.844479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:26.844479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:26.844479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:26.845248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 370/741] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:26.846920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.923315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1823-d618-4bf0-9819-ec10f44f55e7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.952986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613a70-7d12-4a61-a326-f163101fcc74 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:26.957871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.958702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.958989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.959266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.967550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.968997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-4ec8af33-a861-48ec-909d-4792e9efac22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:26.984939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:26.986090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:26.987169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:26.989825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 372/742] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:26.991855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6c3b-a3dc-486b-bfe4-8a8e26d42740 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.992143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6c3b-a3dc-486b-bfe4-8a8e26d42740 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.992418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6c3b-a3dc-486b-bfe4-8a8e26d42740 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.993304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:26.993883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 373/743] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:26.994058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:26.997682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:26.997808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6c3b-a3dc-486b-bfe4-8a8e26d42740 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:26.997886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:26.997886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:26.997886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:26.997886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.010762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 371/744] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:27.010762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.101749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6c3b-a3dc-486b-bfe4-8a8e26d42740 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.117343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b0419-f3b9-4642-8c8f-f56ed2aa4e91 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.135932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.136595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.136885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.137159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.137911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:27.138219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.139575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7dec-d7a1-4c7a-b868-0740bcdebff5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.151914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 374/745] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:27.152182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.152857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.153138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.153415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.154268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.154378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:27.154581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.154985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.155455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.155991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.173679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:27.174759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:27.180883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 372/746] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:27.180883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.244570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 375/747] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 14:43:27.245663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.282295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f801b-86e7-449e-9a8e-26ebc14a551f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.318423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.319205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.319482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.319752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.330438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.332012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.346112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5460bea-3448-4223-b0fe-2b355c35caf5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:27.349161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:27.350067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:27.350960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:27.350960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:27.350960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:27.350960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:27.350960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 373/748] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:27.351712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.383300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.384084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.384363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.384638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.391020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.393008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:27.406960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:27.408332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:27.409313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 376/749] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:27.409920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.462597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768c50-4fc7-4d7c-9fd1-d5bd6d4b8838 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.500439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.501089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.501369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.501713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.508289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263ad0-aa12-44e8-8131-a99c82f9b1d2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.541035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.541720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.542003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.542276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.542986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.544329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.565681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 377/750] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:27 2022] POST /identity/v3/services => generated 240 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:27.565681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.571609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.573089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.680613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f13d2c-0fee-4c9c-9a5b-4d7ac6494875 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.681003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 374/751] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 14:43:27.681852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.717289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.717985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.718266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.718541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.719270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:27.719575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.721938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.734849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 378/752] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:27.735727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.794009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540457a6-2672-4f52-b0c0-f12207c08cd8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.828344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.828996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.829272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.829540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.831039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:27.831316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.832717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.844427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 375/753] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:27.845263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.858448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57534-4a43-45c6-be04-ce316c558597 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.893912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.894708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.894988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.895263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.905772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.907259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:27.925047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:27.926108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 379/754] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:27.927610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:27.945857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8a6d1-1261-4709-98c2-b3ce3c7e1b72 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:27.979697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:27.980547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:27.980819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:27.981129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:27.990103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:27.991642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:28.007170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:28.009566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 376/755] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:28.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.032084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fde97-6c3b-4cb4-b3fc-60e9b48676f4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.067242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.067898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.068179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.068592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.069428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=31f29b5255954eb7acd1c00773731200) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:28.069768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.071209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.077208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 380/756] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:27 2022] GET /identity/v3/role_assignments?user.id=31f29b5255954eb7acd1c00773731200&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:28.078035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.119421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf41e4-e0e1-40c4-a677-d9611b497151 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.185289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.185629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68599d-39a6-4307-ad3d-582996441a91 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.186036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.186316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.186582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.187327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:28.187633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.189878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.222817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.223413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.223695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.223885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:28.224104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.224817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:28.225100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.229223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.234470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.274275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 381/758] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:28.275275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.382087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20836-cabd-4bbf-a67f-c4a92a8b0375 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.420636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7175-2f66-49f4-acdb-96486b9ab245 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.458530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.459375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.459706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.459987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.473046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.473046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.482471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.483280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.483555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.483820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.499804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.502396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:28.502622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:28.503585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:28.508452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:28.508452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:28.508452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:28.508452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:28.508452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 382/759] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:28.509446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:28.529208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:28.530346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:28.531253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:28.537809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 378/760] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:28.538970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.610908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67a673-638f-4cfc-b762-1b2495b6dd31 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.646055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.647044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.647332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.647739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.648466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:28.648771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.650149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.663583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 383/761] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:28.668686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.749693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc82a45-dca5-482b-a90a-a4e71c89c02d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.768469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b026a92-de9c-4479-870d-7ba2e0c1f3d2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:28.803174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.803969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.804251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.804527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.812414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.814501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:28.831225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:28.832181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:28.834296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:28.835321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:28.835321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:28.835321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:28.835321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:28.835893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 384/762] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:28.836033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:28.836033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:28.836033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:28.838802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:28.864301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 379/763] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:28.871456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:29.049691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196c1a-9795-4327-91a1-730e3605440e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:29.119230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:29.119889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.120165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.120433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.121251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b22700cae020412589e7bfdbb00e91bc) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:29.121559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:29.122993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:29.127432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9d59-9824-4e50-b61f-a1b3b92b36e7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:29.135591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 380/764] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/role_assignments?user.id=b22700cae020412589e7bfdbb00e91bc&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:29.175670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:29.176348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.176642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.176912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.177762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:29.178081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:29.179558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b976fc-aebf-48ed-8b7f-a23ce27f3ccf None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:29.194379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 385/765] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:29.199871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:29.383629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a169-22d2-45a1-9910-4c586646b0e1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:29.444036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:29.445287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.445890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.446367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.448534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=b2f119b3cd5647b39942bdc91f95d8df, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:29.450201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22712b1b-0f73-47eb-a761-e1708eec2e9e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:29.481162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 381/766] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:29 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:29.601442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc023-c78e-4090-836b-b0501b9149d9 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.601855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc023-c78e-4090-836b-b0501b9149d9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.602039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc023-c78e-4090-836b-b0501b9149d9 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.603947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 386/767] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:29.609677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.609982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.610259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.629543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:29.630760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:29.702977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 382/768] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:29.727169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc023-c78e-4090-836b-b0501b9149d9 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:29.837973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc023-c78e-4090-836b-b0501b9149d9 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:29.872833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:29.873629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:29.873933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:29.874204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:29.874848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:29.876296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:29.889660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:29.890647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:29.891908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 387/769] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 5 14:43:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:29.898138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.004105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4c9c7-f31a-4c08-b1ef-322d8358ecaa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.043982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.044649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.044925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.045195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.045929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:30.046235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.047589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.053684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 383/770] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:30.059168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.163010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34808d-4048-459e-bab2-caf5a16bfa5b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.211164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.211884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.212169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.212454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.213164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:30.213470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.214858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa62d9-ef3a-4039-8e98-f4dcd3e1e6f7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.226082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 388/771] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:30.231344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.308371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d265-cc1b-4fdc-8b4b-7502dbbecf4e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.308727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d265-cc1b-4fdc-8b4b-7502dbbecf4e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.308892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d265-cc1b-4fdc-8b4b-7502dbbecf4e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.310624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 389/772] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:30.317131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.317415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.317716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.356683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575120-fb17-4baf-8a56-1e70e635849c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.362156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:30.363349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:30.394141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.394817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.395095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.395366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.396160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] RBAC: Adding query filter params (interface=public, service_id=291e92fbd21941caaa85cf936036a2e0, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:30.396469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.398455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.409232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 384/773] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/endpoints?service_id=291e92fbd21941caaa85cf936036a2e0&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:30.415124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.530957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 390/774] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:30.539692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591db4-9dca-43ce-91f8-81956296ae32 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.572482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.573063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.573339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.573604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.574343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.575749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737c71-9d10-4513-a840-85b62b8c69a3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.576889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.599306 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 385/775] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:30.675977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb84d-a56b-4e63-898d-d3b001459f46 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.676330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb84d-a56b-4e63-898d-d3b001459f46 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.676613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb84d-a56b-4e63-898d-d3b001459f46 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.678349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 386/776] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:30.683573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.683856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.684135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.692400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232a895-3c5e-4fb3-90d9-aa096c2b646d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.726995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:30.729904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:30.735668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.741699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.742416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.742877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] PATH_INFO: `/v3/services/network` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.745257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.745257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:30.763483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:30.764626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:30.765503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:30.776319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 391/777] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:30.781485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.874148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 387/778] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:30.894594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bcdac-490b-4042-9453-4dd16382d795 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:30.899414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:30.928781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:30.929850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:30.930353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:30.930822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:30.931716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] RBAC: Adding query filter params (name=network) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:30.932214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:30.933768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:30.939512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 392/779] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:30.945638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.019268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab9c4f-a708-4bfe-aa7d-d7227a4850c2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.057037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.057875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.058155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.058428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.062192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5dc3-043c-4cb8-b792-a1cac501ff93 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.074260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:31.082634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:31.083579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:31.084408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 388/780] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:31.089739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.127451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.128421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.128886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.129321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.130219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] RBAC: Adding query filter params (type=network) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:31.130696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.132265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.143988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 393/781] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:31.150896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.235343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5deb3-3760-4b7a-be10-ee629971b52d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.272533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.273504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.274622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.275071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.276133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:31.277614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.279218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.295138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 389/782] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:31.302743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.365986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33421b2-f1dc-4f6e-a63d-3f1fa437d252 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.406572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386891-d22e-4bbd-9533-cee57e4cf3f8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.442600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.443388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.443664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.443936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.455818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.457250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.462341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.463068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.463351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.463621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.464427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] RBAC: Adding query filter params (interface=public, service_id=359558c71d7d475d81d67411c606d908, region_id=RegionOne) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:31.464728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.466173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:31.476447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:31.477634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:31.478711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:31.478711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:31.478711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:31.478711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:31.478711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 390/783] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:31.487238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.489576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 394/784] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/endpoints?service_id=359558c71d7d475d81d67411c606d908&interface=public®ion_id=RegionOne => generated 194 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:31.498138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.667450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491743f-dcd3-4a99-a864-bc072dfe9e40 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.683215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8b92-7bb7-4d17-b8de-293c029ffd2e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.735481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.736719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.737005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.737279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.738596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.739963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.746771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.747437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.747749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.748031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.748757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:31.749060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:31.750430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dfeb9-e813-4577-8e8a-1b45d17591ee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:31.755202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 395/785] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:31.774867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 391/786] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:31.780498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:31.873446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201db62-bc87-483d-a920-3e8d29483544 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.873816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201db62-bc87-483d-a920-3e8d29483544 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.874018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201db62-bc87-483d-a920-3e8d29483544 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.875480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 392/787] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:31.881395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.881723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.881967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:31.910793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:31.912023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:31.931885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f4a2-f256-4af9-8919-d09b97a69f7b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:31.995444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:31.996254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:31.996534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:31.996803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.014647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.016100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.028579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 393/788] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:32.036798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.037778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:32.039109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 396/789] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:32.043895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.052312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.160886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efaae-ff15-40a1-8266-b3dbf5aec6e0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.168405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442f05b-4c7b-4b1c-890f-3e81bb719f0c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.198540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.199250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.199525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.199796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.211446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.211751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:32.212120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.212402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.212679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.213512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:32.213851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.215270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:32.219158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.221378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:32.223511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 397/790] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:32.233679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.234642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 394/791] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:32.241079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.335446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf01ee-b02f-4d63-815c-4cfec7423772 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.344797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30878-38d5-459b-b83d-3bf0e2a1d674 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.369370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.370100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.370380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.370651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.371425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:32.371732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.373087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.380744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.381537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.381848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.382123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.382356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 398/792] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:32.387743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.397124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.398604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:32.417143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.419332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.421511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:32.421511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:32.421511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:32.421511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:32.421511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 395/793] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:32.424789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.490394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c7f99-d3ac-4e8e-9256-c9a5ceed682f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.526098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a9c-e5c0-414f-9732-05a3be130dd5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.542795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.544074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.544890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.545374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.559727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.561423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.561767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.562176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.562454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.562728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.563756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:32.564104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.565666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795eb6c-810e-4f80-bb55-7eda8f6b5cf6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.578616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 396/794] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:32.580049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75899-5ea0-4cca-a8eb-1f159a4b84db None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-2969712c-a766-43ef-a7f4-2341818dc083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:32.583746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.584849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.585814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:32.585814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:32.585814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:32.585814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:32.586055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75899-5ea0-4cca-a8eb-1f159a4b84db None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.586055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75899-5ea0-4cca-a8eb-1f159a4b84db None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.590456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 397/795] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:32.590456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf75899-5ea0-4cca-a8eb-1f159a4b84db None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.593497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 399/796] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:32.595111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.596390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.596897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.621692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:32.621692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:32.686956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 400/797] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:32.687878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.718368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf75899-5ea0-4cca-a8eb-1f159a4b84db None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.760802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.761515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.761972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.762249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.771134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.772848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:32.790888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.791887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:32.792753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:32.793186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cfae-82de-4ad4-8de1-76f20e8c22b3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.793260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 398/798] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:32.793260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.831790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.832518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.832806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.833084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.833876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:32.834188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:32.835607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:32.852424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 401/799] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:32.852424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:32.912632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305164-7467-4bbe-b151-0a41c415e821 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.952628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:32.954458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:32.955207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:32.955810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:32.969568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:32.971037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017629ea-a909-4579-adce-7dd2a376d957 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:32.979622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:32.980588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:32.981400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:32.984714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 399/800] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:32.984714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.016129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.016561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.016843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.017204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.018064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:33.018446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.019856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.037437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 402/801] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:33.038424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.107576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbd30-1f51-48d2-9afd-0b09a45caa3d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.143188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e496-66fd-4de9-907b-e2b8d4f12c1b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.150340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.151146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.151425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.151699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.160672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.161958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:33.177441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:33.178619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:33.179615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:33.183669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 400/802] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:33.184487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.185047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.185893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.186314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.186747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.188960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:33.189430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.190957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.202201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 403/803] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:33.203344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.298387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b5b64-6479-4efb-963a-31faaea84f91 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.325952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab5b9-6c32-4328-b5aa-a86a14d985ba None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.344267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.346557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.347023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.347577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/31f29b5255954eb7acd1c00773731200/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.350305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=31f29b5255954eb7acd1c00773731200, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.352287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.360923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.362511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.362901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.363260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.364245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:33.364690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.366284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a62fe9-6ed2-4df4-b703-c44033a66b9e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.371433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 401/804] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:33 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/31f29b5255954eb7acd1c00773731200/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:33.372464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.409400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 404/805] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:33.411045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81171-cc6a-422b-884b-43bcf42988ba None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.411399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81171-cc6a-422b-884b-43bcf42988ba None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.411746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81171-cc6a-422b-884b-43bcf42988ba None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.413138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 405/806] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:33.418724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e81171-cc6a-422b-884b-43bcf42988ba None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.508418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553e35-4bd2-4f2b-8040-af143c66639b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.544368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.545165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.545445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.546069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.554164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e81171-cc6a-422b-884b-43bcf42988ba None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.560594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.562429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5da5a774-9964-4b6e-96af-222ffa558b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:33.585236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:33.586243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:33.587121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:33.587121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:33.587121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:33.587121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:33.588827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 402/807] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:33.590214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.590501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.590775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.593197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.594681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.594967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.595812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.609860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.611078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:33.611752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.612439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:33.630265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:33.631209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 406/808] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:33.632679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.708593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 403/809] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:33.708593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.747044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b96aa-4a2f-44a7-9a3e-c0c37fa38931 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.786824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.788087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.788763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.789535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.790768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:33.791286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.793026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.807783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 407/810] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:33.809173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.832630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4645-2d40-42a1-896e-62e4371db4ef None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.867611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.868260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.868598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.868873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.869754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:33.869975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.871388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.888160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 404/811] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:33.889019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:33.936513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cbe6d-1e71-4a66-abbc-c0a922323428 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:33.980320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:33.982011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:33.982505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:33.983125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:33.984265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:33.986306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:33.989489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269977-3d3d-43f5-85e5-283bc0d56ebc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:34.002212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:34.003175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 14:43:34.004014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:34.011481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 408/812] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:34.011481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.038033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.038830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.039099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.039374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.049637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.051094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:34.069062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:34.070269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:43:34.071232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:34.078242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 405/813] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:43:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:34.079329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.124366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd496c4c-6e66-419b-b819-33a798bfd5b6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.159731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.160482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.160763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.161031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.167775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.169201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:34.184725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:34.185684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:34.186592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:34.187526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55990ac-3e68-4a47-9b29-e9cd7a3b6be0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.190007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 409/814] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:34.191318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.223735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.224815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.225355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.225905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.226814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:34.227363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.228968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.234334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 406/815] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:34.235407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.313249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5adc15-8cb3-4225-a004-808fdffe7ed8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.354621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.355717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.356207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.356694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.357790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:34.358322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.359948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.379777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe156bf5-6edd-4653-be8b-7eab154c4dbb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.384763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 410/816] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:34.384763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.422699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.423408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.423694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.423967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.424758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:34.425067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.432746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.453721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 407/817] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:34.455485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.496207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224975a-d9c9-4bbc-867a-995ca1973f5d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.529203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.529889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.530171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.530442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.531146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:34.531448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.533347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.538121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 411/818] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:34.538868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.568367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c151-001b-47a2-93af-dd8c3f70225e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.603347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.603996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.604276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.604549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.636727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9e29-2da0-46db-907c-a8db33fea0eb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.669766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.670806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.671093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.671372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b22700cae020412589e7bfdbb00e91bc/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.680431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.682109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3b4f-f655-4221-9730-8f6c0fcc6517 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.685467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=b22700cae020412589e7bfdbb00e91bc, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.686902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ea04f-0d0b-4538-9161-798b9ba7ba0c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.700081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 412/819] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:34 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b22700cae020412589e7bfdbb00e91bc/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:34.701509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450e35-b100-46f5-88fc-80a233791c13 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.701898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450e35-b100-46f5-88fc-80a233791c13 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.702243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450e35-b100-46f5-88fc-80a233791c13 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.705741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 413/820] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:34.705741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450e35-b100-46f5-88fc-80a233791c13 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.808316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 408/821] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:43:34.809947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.810336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.810690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.829073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:34.831180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450e35-b100-46f5-88fc-80a233791c13 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:34.831545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:34.868483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:34.869474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:34.869957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:34.870467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:34.871446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:34.873033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:34.899025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 414/822] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:34.899886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:34.933229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 409/823] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:34.960375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.038408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f75c9-ec94-40bd-b247-a4605a5b26f5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.074823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.075630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.075931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.076190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.087913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.089380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.105837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794af9-82da-406c-9417-b551b4950bc4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:35.107634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:35.108535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:35.109442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:35.109442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:35.109442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:35.109442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:35.109442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 415/824] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:35.117303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.151376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.152533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.153019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.155143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] PATH_INFO: `/v3/services/network` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.156809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.161590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:35.177375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:35.178461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:35.179284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 410/825] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:34 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:35.185146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.252761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b911a-0a3d-4cd3-91c5-c2b0291c3d13 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.288510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.289597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.290124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.290640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.291207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c349d-7809-4f4a-adf7-0ee5afc3fb3f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.291777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:35.292305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.293882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.306918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 416/826] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:35.314608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.335105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.336136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.336619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.337110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.338045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] RBAC: Adding query filter params (name=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:35.338554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.340195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.345909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 411/827] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:35.351445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.422986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbdd9-4e53-4676-9574-c783ce1c20d3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.457543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351580-734f-4164-8863-9e0f7431ffcd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.458155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.458948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.459235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.459510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.466494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.467937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:35.482314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:35.483351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:35.484837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 417/828] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:35.489294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.499732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.500764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.501054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.501902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.502917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] RBAC: Adding query filter params (type=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:35.503396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.505143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.511634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 412/829] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:35.517744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.600965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306e71-b874-44da-a6fa-02da5dd65400 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.649292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.650005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.651147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.651638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.652463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:35.652778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.654289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.671181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d38b5-9450-4d47-9edd-ba820a4cd624 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.686041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 418/830] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:35.693981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:35.752408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.753264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.753542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.753843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.754600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.755957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8e4f8-6997-45bf-b21e-a09ae57c19bc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.797354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 413/831] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:35.812059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d2d5-3285-4250-8726-f26d261d463b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:35.853336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1578ac-039a-42b9-9bf1-a428307bde3e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.853680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1578ac-039a-42b9-9bf1-a428307bde3e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.853921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1578ac-039a-42b9-9bf1-a428307bde3e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.855705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 414/832] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:35.861543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.861872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.862162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.889770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:35.890449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:35.890718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:35.891040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:35.891886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:35.894705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:35.895978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:35.897179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:35.899114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:35.912270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 419/833] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:35 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:35.976214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 415/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:36.011461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:36.151942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f352b-829f-46f3-8689-2ae3524f6896 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:36.192953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:36.193811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:36.194122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:36.194363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:36.209205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:36.217274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:36.218246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:43:36.219097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:36.222730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 420/835] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:36.228815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:36.334128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e57c3-90f6-4807-b74b-8052f81eb753 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:36.367636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:36.368299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:36.368583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:36.368855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:36.369594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:36.369922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:36.371275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:36.380537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 416/836] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:36.386022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:36.491651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0782-3778-481e-8f3f-cebec152e113 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:36.524984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:36.525789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:36.526066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:36.526336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:36.536925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:36.538441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:36.557898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:36.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:36.559799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:36.559799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:36.559799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:36.559799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:36.559799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 421/837] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:36.566521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:36.670984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cbe82-c505-4b11-8430-2de9c8a5f44d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:36.705102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:36.705835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:36.706133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:36.706406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:36.707126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:36.707418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:36.708779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:36.721791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 417/838] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:36.727257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:36.828083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf053-23a7-46fb-8a75-4016857cdfd2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:36.865835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:36.866626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:36.866905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:36.867177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:36.874768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:36.876188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:36.890126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:36.891116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:36.892432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:36.898817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.003374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107c8f-4bb8-4318-a902-45346e5b381d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.037674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.038350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.038630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.038900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.039723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:37.040027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:37.041443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06d93c-d538-4b8a-8598-0329149c1b8a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:37.059839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 418/840] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 5 14:43:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:37.066132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.177702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0e98-1d14-46ae-bf2e-a3c9e879b6b4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.215689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.216336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.216615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.216890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.295096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:37.296535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:37.368647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92112c1-29ec-4c7e-9e00-474ea3e04e18 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.369161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92112c1-29ec-4c7e-9e00-474ea3e04e18 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.369239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92112c1-29ec-4c7e-9e00-474ea3e04e18 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.370838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 419/841] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:37.379050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.379656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.380155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.399506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:37.400680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:37.445220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 423/842] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:43:37.451387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.504209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 420/843] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:37.529083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.580517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e055-cb6d-42d4-bcbf-599d2884af60 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.633932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.634917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.635296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.635781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.646672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2175-60ac-4273-93ea-171af26c95e4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.651681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:37.653573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:37.677264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:37.678291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:37.679221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:37.679221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:37.679221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:37.679221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:37.685834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 424/844] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:37.687240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.692490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.693935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.694423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.694923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.708018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:37.721479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:37.722497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:43:37.723339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:37.726109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 421/845] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:37.732262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.813026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c692de-ac97-4c46-9438-9200a65a947f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.841571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1914b5-debf-4ad5-8eb7-1a35c56cf005 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:37.855319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.856898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.856898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.856898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.857216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:37.857523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:37.858928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95059a3-9b2a-46c5-95c8-6450b338987b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:37.873995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 425/846] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:37.875501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46783a-ab47-49c1-b22b-204d40c8295e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.875855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46783a-ab47-49c1-b22b-204d40c8295e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.876137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46783a-ab47-49c1-b22b-204d40c8295e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.878447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 426/847] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:37.882809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46783a-ab47-49c1-b22b-204d40c8295e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:37.889086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:37.889799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.890098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.890397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.891096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:37.891398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:37.892944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ff13-2daa-4cb8-bc46-25a4e891c779 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:37.910896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 422/848] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:37.910896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:37.910896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:37.910896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:37.927135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:37.928328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:38.010084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46783a-ab47-49c1-b22b-204d40c8295e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.010465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 423/849] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:38.011731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.065460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.066391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.066671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.066941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.074653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.076083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:38.092753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:38.093969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:38.094903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:38.101929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 427/850] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:38.103623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.123502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248a1cd-ffcb-4154-904b-9f643e31fcf7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.164227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.165020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.165300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.165568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.176332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.177787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:38.195960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:38.196882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:38.198087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:38.198087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:38.198087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:38.198087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:38.198087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 424/851] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:38.198365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.216725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e6e58-68f0-484e-b11e-f33b3ace3e13 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.252288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.253670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.254075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.254447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.255225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.256770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:38.270358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:38.271623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:38.272642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:38.278174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 428/852] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:38.279431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.304276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb28f-eb89-4dc9-a507-921669ff9607 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.341908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.342827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.343107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.343382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.344161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.344473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.345947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.357892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 425/853] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.358721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.394377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61a6f-605b-4e1e-a1bd-9b5ad4426fae None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.435707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.436468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.436862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.437230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.438074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.439349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.440776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.452508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 429/854] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.453430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.464418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b569-bdc7-4b96-aa5c-5665c6f81463 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.497135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.497829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.498113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.498388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.499083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.499388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.500741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b841e7-2403-449e-a1a2-9e021eb5edea None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.505522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 426/855] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.506744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4083e-334b-4cd6-aaa5-e6dbbb9e02a7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.507026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4083e-334b-4cd6-aaa5-e6dbbb9e02a7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.507301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4083e-334b-4cd6-aaa5-e6dbbb9e02a7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.508511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 427/856] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:38.509192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4083e-334b-4cd6-aaa5-e6dbbb9e02a7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.553060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5dc71-e6d4-49bf-bf54-284b5a0adb87 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.585993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.586621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.586901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.587173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.587987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=31f29b5255954eb7acd1c00773731200) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.588296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.589727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.595772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 430/857] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/role_assignments?user.id=31f29b5255954eb7acd1c00773731200&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.596622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.607195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4083e-334b-4cd6-aaa5-e6dbbb9e02a7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.644977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.645990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.646363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.646758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.654607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.656246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-121f5125-9eb8-4e82-8f79-f5c4c45dd1a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:38.672469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:38.673738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:38.674922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:38.680858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 428/858] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:38.680858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.680858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.680858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.696807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:38.698158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:38.713899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222941ae-6ba4-44ef-8910-8e83087a2d2b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.755134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.755808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.756091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.756589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.757086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.757394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.758814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.773991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 431/859] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.773991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.786180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 429/860] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:38.810815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.877606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028854af-ac5b-4ae7-9f89-1167b5e1b509 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.923597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.925267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.925691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.926069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.927207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:38.927621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.929860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.931016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77414-35ee-4084-83db-aa0fb408af31 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:38.955194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 432/861] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:38.960664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:38.978514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:38.979430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:38.979776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:38.980111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:38.980846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:38.982580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:38.996903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:38.997944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:38.998950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:39.005115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 430/862] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:39.007205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.082227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe7f7-7965-4a78-819e-13f27cd0f2c7 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.119547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.120349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.120731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.121542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.133096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adeb44-7134-40f4-b7c5-48c82d6f7510 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.167056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.167760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.168036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.168305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.169000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:39.169310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.170733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.180685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 431/863] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:39.181978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.206363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.207958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.297381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11b94-8d4a-4cf0-bc6b-ff2ce279f655 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.318164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 433/864] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:43:39.323852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.340481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.341231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.341767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.342415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.343216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:39.343616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.345528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.353743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 432/865] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:39.437744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad07e2-4f2d-4734-ba94-690d34b06549 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.476386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.477202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.477482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.477786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.490037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.491608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:39.511491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:39.512633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:39.513744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:39.513744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:39.513744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:39.513744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:39.513744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 434/866] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:39.519593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.629154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694cc-93ca-4e2b-b205-ff6db5ef6d64 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.662964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.663624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.663903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.664175 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.664889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:39.665190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.666572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.680218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 433/867] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:39.685753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.787215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4200-0a3a-4298-b156-31fbb381ae9e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:39.823768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:39.824578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:39.824854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:39.825125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:39.833399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:39.834962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:39.853077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:39.854181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:39.855282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:39.857061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 435/868] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:39.863459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:39.967050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ae345-2922-493c-a242-5accc18a1793 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:40.004141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:40.004797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:40.005234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:40.005509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:40.006311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:40.006613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:40.008022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0bb6-5fa3-4606-ab96-eb9199a831a5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:40.020752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 434/869] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:40.026548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:40.126791 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a95d-66f7-4ba9-803d-7564507a25c4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:40.159787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:40.160436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:40.160714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:40.160985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:40.161829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b22700cae020412589e7bfdbb00e91bc) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:40.162142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:40.163551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a983b-2b74-4e0e-8b06-1bcac99d479d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:40.169672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 436/870] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:40 2022] GET /identity/v3/role_assignments?user.id=b22700cae020412589e7bfdbb00e91bc&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:40.950807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2664-cd2f-4102-82e4-98f0e8c2d76f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:40.951346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2664-cd2f-4102-82e4-98f0e8c2d76f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:40.951346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2664-cd2f-4102-82e4-98f0e8c2d76f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:40.953059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 435/871] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:40.959057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390cc33-b9e0-4952-8854-f868b8d462a6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:40.959339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390cc33-b9e0-4952-8854-f868b8d462a6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:40.959620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390cc33-b9e0-4952-8854-f868b8d462a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:40.977341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6390cc33-b9e0-4952-8854-f868b8d462a6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:40.978542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6390cc33-b9e0-4952-8854-f868b8d462a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:41.049763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 437/872] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:41.067732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b2664-cd2f-4102-82e4-98f0e8c2d76f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:41.121467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840696c-3529-4b5d-b728-a37fe329b686 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.121804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840696c-3529-4b5d-b728-a37fe329b686 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.122061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840696c-3529-4b5d-b728-a37fe329b686 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.123674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 438/873] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:41.128575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337be18-97ed-4906-b410-d23358efd30f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.128860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337be18-97ed-4906-b410-d23358efd30f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.129155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337be18-97ed-4906-b410-d23358efd30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.148512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4337be18-97ed-4906-b410-d23358efd30f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:41.149748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4337be18-97ed-4906-b410-d23358efd30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:41.180723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b2664-cd2f-4102-82e4-98f0e8c2d76f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:41.215302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:41.216020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.216298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.216573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.217217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:41.218613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:41.230816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 439/874] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:41.231163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:41.232092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:41.232923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 436/875] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:41.238801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337be18-97ed-4906-b410-d23358efd30f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:41.253173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:41.353510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912e2-7221-4666-af1b-033f376e5375 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:41.358299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337be18-97ed-4906-b410-d23358efd30f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:41.392927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:41.393596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.393925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.394206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.394932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:41.396364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb165ba-08ad-46f1-a31f-0f1fcac06a13 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:41.397739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:41.398557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.398979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.399393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.400228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:41.400693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:41.402478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:41.412875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 440/876] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:41.414477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:41.417844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 437/877] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:41 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:43:41.535290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f66a-35d3-447e-8743-99f7443d19c9 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:41.583714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:41.584388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.584665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.584936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.585665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:41.585983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:41.587361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da49c9e-5615-44fc-88af-40d154745e7c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:41.597822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 441/878] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:41.745950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7be06-acaf-4542-8dac-631f7c0a8a51 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.746258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7be06-acaf-4542-8dac-631f7c0a8a51 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.746504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7be06-acaf-4542-8dac-631f7c0a8a51 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.748223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 438/879] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:41.753997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9824a-78e0-424e-b6ad-dd4aeb6c5a6d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:41.754320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9824a-78e0-424e-b6ad-dd4aeb6c5a6d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:41.754561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9824a-78e0-424e-b6ad-dd4aeb6c5a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:41.772372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-83c9824a-78e0-424e-b6ad-dd4aeb6c5a6d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:41.773558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-83c9824a-78e0-424e-b6ad-dd4aeb6c5a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:41.847002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 442/880] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:41.868886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7be06-acaf-4542-8dac-631f7c0a8a51 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:41.971640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7be06-acaf-4542-8dac-631f7c0a8a51 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:42.005810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:42.006475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:42.006758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:42.007035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:42.007753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:42.009111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aeecc-04a6-4863-8573-f19075f9eada None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:42.024750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 439/881] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:41 2022] POST /identity/v3/services => generated 269 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:42.663317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a597f-d80b-49fd-a461-a83595b1d6d1 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:42.664383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a597f-d80b-49fd-a461-a83595b1d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:42.664894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a597f-d80b-49fd-a461-a83595b1d6d1 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:42.666738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 443/882] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:42.671989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:42.672508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:42.673537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:42.690674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:42.692128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:42.765854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 440/883] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:42.790583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a597f-d80b-49fd-a461-a83595b1d6d1 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:42.893233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a597f-d80b-49fd-a461-a83595b1d6d1 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:42.926649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:42.927449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:42.927721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:42.928046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:42.938056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:42.947164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:42.948146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:42.949045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 444/884] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:43:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:42.956782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.058124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643068a6-75a4-4082-9a44-fdbf8d194af6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.093570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.094274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.094556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.094871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.095707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:43.095924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:43.097300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:43.106206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 441/885] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:43:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:43.111859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.219156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13777c9f-237e-43a7-a304-313ac75500f4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.254399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.255557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.256049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.256566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.267767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:43.269526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:43.287089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:43.288119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:43.288996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:43.288996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:43.288996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:43.288996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:43.291595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 445/886] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:43.297355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.400302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dfb6-d602-4f99-a285-3822797546af None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.442796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.443817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.444318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.444800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.445782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:43.446333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:43.447885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:43.461407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 442/887] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:43.467201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.568342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa2b00-437c-41b7-8c92-8addc39b33d4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.602569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.603663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.604101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.604528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.613041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:43.614709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:43.630580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:43.631807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:43.632948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:43.635317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 446/888] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:43.641264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.748453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbdf87-1cec-4dda-beb5-13f4589a7830 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.782977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.783677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.783954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.784221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.785041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:43.785341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:43.786793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b619c17-bda1-4945-bb41-66ef17e620a5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:43.805369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 443/889] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:43.810741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:43.841493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082791-9bf4-4776-8377-d45d978ce9a1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.842140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082791-9bf4-4776-8377-d45d978ce9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.842605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082791-9bf4-4776-8377-d45d978ce9a1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.844406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 444/890] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:43.850386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d046c-ea03-4e6e-8ec3-602bfd6cde16 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.850936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d046c-ea03-4e6e-8ec3-602bfd6cde16 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.851404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d046c-ea03-4e6e-8ec3-602bfd6cde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.868511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7f5d046c-ea03-4e6e-8ec3-602bfd6cde16 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:43.870043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f5d046c-ea03-4e6e-8ec3-602bfd6cde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:43.915972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f4de-78c1-4318-8f38-8116742f5abf None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:43.941740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 445/891] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:43.943360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dfe02-9be4-4aee-8901-f641da7e13ee None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.943653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dfe02-9be4-4aee-8901-f641da7e13ee None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.943927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dfe02-9be4-4aee-8901-f641da7e13ee None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.945298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 446/892] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:43.950444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.950736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.951017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.961824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:43.962815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:43.963294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:43.963817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:43.967926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:43.969101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:44.032204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.034060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.035873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 447/893] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:44.037804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.131991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3f3a-b2ce-4c62-a287-d1c8315e78cf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.145286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 447/894] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:43 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 14:43:44.146126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.174418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.175227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.175503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.175770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.176424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.177867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:44.190858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:44.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:44.192854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 448/895] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:44.193707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.255357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6022e4-edb9-4694-9182-56fb9e757b67 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.287981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.288924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.289374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.289850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.290562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.291806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f29ac-7106-4076-ab88-feca39c90099 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.291914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.306509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 448/896] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:44 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:44.307640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.353547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.355190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.355732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.356229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.372157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.373714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e787d871-51c8-48eb-b77d-4191a348257d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:44.397346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:44.398363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:44.399309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:44.399309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:44.399309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:44.399309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:44.399309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 449/897] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:44.400586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de2ee-ff00-48e5-b01c-d9da969a6aeb None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.400586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de2ee-ff00-48e5-b01c-d9da969a6aeb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.400586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de2ee-ff00-48e5-b01c-d9da969a6aeb None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.401863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 450/898] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:44.406735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de2ee-ff00-48e5-b01c-d9da969a6aeb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.430265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb38f1-987e-4571-af22-0d9de192fedc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.466213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d302568-b88a-4960-a981-1677c41897be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.466945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302568-b88a-4960-a981-1677c41897be None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.467224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302568-b88a-4960-a981-1677c41897be None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.467496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302568-b88a-4960-a981-1677c41897be None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.470367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d302568-b88a-4960-a981-1677c41897be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:44.470367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d302568-b88a-4960-a981-1677c41897be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.470610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d302568-b88a-4960-a981-1677c41897be None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.477544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 449/899] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:44.479299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.479589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.479863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.497684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:44.498889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:44.530227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de2ee-ff00-48e5-b01c-d9da969a6aeb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.566296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.566994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.567310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.567586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.568310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:44.568615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.570003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.581705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 450/900] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:44.581705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.582072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 451/901] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:44.586800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.682767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e072-c454-4624-865f-cd64c58b362a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.688151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c623e-686e-4003-99a7-9f62d64f315a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.715883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.716668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.716945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.717214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.723713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.723878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.724377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.724662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.724941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.725136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.725695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:44.725981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.727325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.737310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 451/902] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:44.737310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:44.740126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:44.741162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 452/903] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:44.742130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.842969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dfa6a-37d3-4622-9bf2-9c7dcca1977d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.853198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d2568-4ffc-4834-ac52-3e95dbd4bde5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:44.878994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.879810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.880399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.880678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.881613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] RBAC: Adding query filter params (interface=public, service_id=756ccb053c1d49a09b8d3565a13c759c, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:44.881968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.883323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.887451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:44.892901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 453/904] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/endpoints?service_id=756ccb053c1d49a09b8d3565a13c759c&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:44.893037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:44.893037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:44.893037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:44.893266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.893340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:44.893340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:44.905930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:44.906861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:44.907920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 452/905] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:44.909297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:44.998079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b765c-ad08-47ac-b73a-b42aca3a2622 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.003968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3dc42-add7-47f8-84a7-3eee937341c0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.034782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.035793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.036279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.036776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.037758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.038057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:45.038409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.038685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.038955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.039196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.039625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.040962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.041244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.046669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 453/906] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/services => generated 1497 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:43:45.047433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:45.066556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 454/907] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:45.072520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:45.175205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54a02a-009d-4b5f-8444-96a2cc35536f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.208983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f961e-0e3d-43ac-b470-a8af452482d9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.215904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.216838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.217291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.217760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.218621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:45.219651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.222165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.229556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 454/908] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:45.234639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:45.254102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.254694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.254972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.255241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.256465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] RBAC: Adding query filter params (role.id=3f6dde19e19b4a09bf6cca4b2b28bc15, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b22700cae020412589e7bfdbb00e91bc) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:45.256775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.258463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.274116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 455/909] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:45 2022] GET /identity/v3/role_assignments?user.id=b22700cae020412589e7bfdbb00e91bc&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:45.358941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b85ff7-b2f0-4738-b096-b5b0016a9f00 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.395968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.396648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.396926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.397202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.397952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:45.398264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.399648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.405454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 455/910] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:45.412280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:45.529702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182567e8-112a-4e42-919a-9cf25cca2e05 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.563207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.564192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.564192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.564812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.565588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] RBAC: Adding query filter params (interface=public, service_id=d6ce83bb1356474fbc205d56b5c3560d, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:45.565924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.567269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ebdb-8e77-4a73-a889-f2820c7a528b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.572760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 456/911] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:45 2022] GET /identity/v3/endpoints?service_id=d6ce83bb1356474fbc205d56b5c3560d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:45.578175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:45.680594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925b0e-7f58-45ff-bf65-25a5e1e5d2e1 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:45.714689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:45.715653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:45.716140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:45.716622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:45.717513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:45.721419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdbcd8-3f88-4686-a04c-2e3419378f6a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:45.727846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 456/912] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:45 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:43:46.613019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64915-f0f9-4cec-9292-bd4b7520d769 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:46.613564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64915-f0f9-4cec-9292-bd4b7520d769 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:46.613564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64915-f0f9-4cec-9292-bd4b7520d769 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:46.615080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 457/913] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:46.620487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:46.620877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:46.621042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:46.638784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:46.639960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:46.709458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 457/914] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:46.732714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64915-f0f9-4cec-9292-bd4b7520d769 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:46.837778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64915-f0f9-4cec-9292-bd4b7520d769 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:46.872184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:46.873335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:46.873856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:46.874328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:46.875189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:46.877502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:46.889817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:46.890847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:46.892270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:46.899809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 458/915] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:46.901390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.005827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63e98f-cafb-4de6-8c74-294a23aa7b80 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.040776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.041443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.041755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.042034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.042738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:47.043045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:47.044407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:47.049691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 458/916] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:47.055412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.163953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef692-55cf-499d-907d-b5626699d414 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.198774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.199444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.199720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.199992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.200805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:47.201119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:47.202486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:47.207773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 459/917] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:47.213630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.320599 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919b19-3bce-437f-ba7c-2ea27e06527c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.359202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.359880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.360164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.361194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.362133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] RBAC: Adding query filter params (interface=public, service_id=d3cf1024b50b4592a93b2d4052c870bc, region_id=RegionOne) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:47.362452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:47.363863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30bdd-db99-4872-b9de-f72e5da818e2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:47.370173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 459/918] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/endpoints?service_id=d3cf1024b50b4592a93b2d4052c870bc&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:47.375800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.476690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93af53-0859-4938-bdfa-ed5f30a4abd7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.512156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.512820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.513095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.513364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.514074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:47.515421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec01c-0ad3-4d1d-a53f-98ab3c4c9652 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:47.522543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 460/919] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:43:47.528834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b731-4a29-4bb3-8061-c14181beeb32 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.529130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b731-4a29-4bb3-8061-c14181beeb32 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.529383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b731-4a29-4bb3-8061-c14181beeb32 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.530987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 460/920] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:47.535696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abe1e-6c05-4988-a2f5-1b7c3d0a4778 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.536072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abe1e-6c05-4988-a2f5-1b7c3d0a4778 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.536334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414abe1e-6c05-4988-a2f5-1b7c3d0a4778 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.537478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.537809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.538032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 461/921] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:47.538139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.543527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.543834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.544079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.559714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:47.561319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:47.562887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:47.564712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:47.649751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 461/922] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:47.653265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 462/923] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:47.669064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.681063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.779840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172a14-0672-44c1-9e29-7d0d898ea0e3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.795755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c0886-c4bb-49d6-9800-c4133474c83c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.818246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.819181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.819535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.819875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.820590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:47.822398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:47.834630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:47.835631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 14:43:47.836462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:47.837190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:47.837190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:47.837190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:47.837478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 462/924] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:47.837547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:47.844415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.848174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:47.857010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:47.858236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:47.859073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:47.867637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 463/925] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:47.868750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:47.972819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49ace-e021-44a8-92b4-49e40480b180 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:47.973679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23ad9d-b560-4bda-8138-d47e90396c3c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.010538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.011564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.012074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.012543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.013452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.013991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.014231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.014892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.015170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.015442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.016183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.017036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.018004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.018627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.027965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 464/926] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:48.028542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 463/927] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:48.028650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.034971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.144586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1f79-0f78-4c71-bdb3-15471134f5cd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.145763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e349e-c392-4afe-bde9-d3c0b4bc8b1e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.180049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.180277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.180707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.180933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.181031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.181218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.181312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.181494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.181949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.182256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.183605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fa892-3800-4f78-9eb8-4e29e910325e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.188347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 465/928] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:48.192650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.194118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.194247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011476-c30f-4f54-b9ac-9590272027cd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.194535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011476-c30f-4f54-b9ac-9590272027cd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.194812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011476-c30f-4f54-b9ac-9590272027cd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.196188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 466/929] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:48.196725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59011476-c30f-4f54-b9ac-9590272027cd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-fc6342d2-c6a3-4069-a114-d839343603ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:48.215968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:48.216883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 464/930] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.223708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.236747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:48.237944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:48.304639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59011476-c30f-4f54-b9ac-9590272027cd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.305762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 465/931] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:48.306721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.347611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.348678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.349178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.349680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.350616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.352272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.377694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 467/932] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:48.377694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.427007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bc7cc-605f-45a4-9e04-bff3735bbfb2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.470489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.471184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.471463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.471737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.472469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.472777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.474307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.487475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 466/933] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:48.493976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.506432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eaa9-dbbd-4c7d-8f42-6df06a3174ca None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.544672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.545496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.545826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.546101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.546767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.548242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:48.561455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:48.562504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 14:43:48.563406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:48.568193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 468/934] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:48.569069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.623596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cecf5-16ad-49d8-ac94-2185bf3b6a6e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.659484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.660381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.660735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.661089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.669098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.670713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:48.685764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:48.686951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:48.688122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:48.689489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 467/935] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:48.694274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.697592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cadf-91d2-439f-aa6c-354d9bff7028 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.734112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.734698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.735024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.735869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.736578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.736882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.738270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.743611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 469/936] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:48.749797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.812592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947e9b1-fad9-4061-8b7c-a452fc947ba3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.847779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.848806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.849159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33030-a1a0-4a9c-89ae-137a70acaddf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:48.849531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.850030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.851097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.851610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.853234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.872255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 468/937] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:48.881794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.890780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:48.891892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:48.892411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:48.892886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:48.893838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:48.894380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:48.895836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:48.900954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 470/938] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:48.906096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:48.999322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e212cd4-1b23-4077-a3ef-167da0208c0f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.038411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5052b-79f4-4449-b603-acf6ef5e1bf1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.040337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.042190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.042665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.043154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.056998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.059195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.075963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.076879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.077408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.077892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:49.078729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:49.079945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:49.080876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:49.080876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:49.080876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:49.080876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:49.080876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 469/939] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:49.081434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.083035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.085558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:49.114307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 471/940] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:43:49.199865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad871997-e0c2-47f6-bf66-c6fc3592f4a8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.245107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.245861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.246141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.246414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.247141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:49.247453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.248939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.262721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 470/941] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:49.268557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:49.378190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdca71-95dd-46e1-acd6-2cf0495ce8b7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.413465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.414545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.414979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.415406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.422321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.423978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:49.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:49.446177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:49.447262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:49.449490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 472/942] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:49.456231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:49.562903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed9766-f0b5-42c5-8137-47c2b0280b92 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.597971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.598634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.598915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.599183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.599954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:49.600264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.601718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dcdde-e476-492b-84e0-fae9b8b781e6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.616816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 471/943] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:49.622694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:49.726202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24c-97ed-4303-a36e-17324041995a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:49.762205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:49.763331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.763759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.764176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b22700cae020412589e7bfdbb00e91bc/roles/3f6dde19e19b4a09bf6cca4b2b28bc15` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.766630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=b22700cae020412589e7bfdbb00e91bc, role_id=3f6dde19e19b4a09bf6cca4b2b28bc15)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:49.768355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142681-916a-4d12-9277-9d4298d25a53 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:49.785258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 473/944] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:43:49 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b22700cae020412589e7bfdbb00e91bc/roles/3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:43:49.910448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa103d-dc93-4863-89e6-853c4e54bad2 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.910956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa103d-dc93-4863-89e6-853c4e54bad2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.911108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa103d-dc93-4863-89e6-853c4e54bad2 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.912829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 472/945] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:49.918635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:49.919236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:49.919752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:49.938200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:49.940364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:50.011095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 474/946] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:50.035092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa103d-dc93-4863-89e6-853c4e54bad2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:50.138803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa103d-dc93-4863-89e6-853c4e54bad2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:50.172605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:50.174018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.174296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.174564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.175210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:50.176600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:50.189591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:50.190673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:50.191517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 473/947] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:50.197002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:50.297514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2418-499e-4e04-8d8b-8251e16cba1e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:50.333795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:50.334459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.334736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.335005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.335703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:50.336004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:50.337456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:50.342535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 475/948] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:50.349269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:50.452282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2116-0233-4e3c-80ba-8cfb4dc4a265 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:50.485898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:50.486560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.486889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.487166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.487870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:50.488174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:50.489530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec728bd-b411-4a47-b907-1e100ad662f4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:50.494980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 474/949] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:50.503002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:50.604300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30cb84-2419-45fa-9b3a-94845375ce55 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:50.640300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:50.640963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.641242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.642161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.642901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:50.644263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06534d21-70f3-4c4c-9753-229a4bc81d6b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:50.664684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 476/950] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:50.786479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aac20-e049-485f-b749-635a43448fdc None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.786679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aac20-e049-485f-b749-635a43448fdc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.786992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aac20-e049-485f-b749-635a43448fdc None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.788685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 475/951] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:50.794360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:50.794906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:50.794906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:50.813395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:50.815200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:50.891789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 477/952] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:50.916086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aac20-e049-485f-b749-635a43448fdc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:51.023853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aac20-e049-485f-b749-635a43448fdc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:51.058676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:51.059564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.059993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.060719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.061555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:51.063143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:51.065356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING keystone.server.flask.common [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 14:43:51.084923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.sql.core [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 14:43:51.084923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 14:43:51.084923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [parameters: {'id': '0605d9d4c7b74acbaa7bd9e90414ce17', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 14:43:51.084923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0605d9d4c7b74acbaa7bd9e90414ce17.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0605d9d4c7b74acbaa7bd9e90414ce17. May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:43:51.093439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 05 14:43:51.094411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return project_ref.to_dict() May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application yield resource May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.rollback() May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.force_reraise() May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise self.value May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application session.commit() May 05 14:43:51.095473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._prepare_impl() May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.flush() May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._flush(objects) May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application compat.raise_( May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application flush_context.execute() May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 14:43:51.096442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rec.execute(self) May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 14:43:51.097335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:43:51.098159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [parameters: {'id': '0605d9d4c7b74acbaa7bd9e90414ce17', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.099001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:51.099769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.Conflict( May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0605d9d4c7b74acbaa7bd9e90414ce17. May 05 14:43:51.100669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:51.102875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 476/953] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 5 14:43:50 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:51.108895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:51.210000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3534f-2ead-4604-9be4-a277759081bf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:51.244741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:51.245588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.245902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.246176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.253308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:51.254789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e3d8d165-76f6-4ace-8bf8-e3aeb22b835c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:51.268737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:51.269627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:51.270534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 478/954] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:51.278344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:51.387053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fccc42-4620-477b-9395-b624e243c307 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:51.422277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:51.423865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.424380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.424867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.425872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:51.426393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:51.428230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb234-73a4-4f7c-b1a9-a5336288bbe9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:51.450685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 477/955] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:51.539383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f15c-be40-4c9f-b383-ee0196ac44f4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.539751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f15c-be40-4c9f-b383-ee0196ac44f4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.539946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f15c-be40-4c9f-b383-ee0196ac44f4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.541679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 479/956] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:51.547438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.548332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.548636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.569248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:51.570826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:51.649169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 478/957] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:51.671771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f15c-be40-4c9f-b383-ee0196ac44f4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:51.777583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f15c-be40-4c9f-b383-ee0196ac44f4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:51.812624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:51.814059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.814335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.814741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.815389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:51.816842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:51.828548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:51.829632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:51.830485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 480/958] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:51.836035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:51.943479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd783a-7efc-4c67-939f-53aa5382d062 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:51.978608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:51.979705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:51.980198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:51.980687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:51.981696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:51.982243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:51.983882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc06c-4f8e-44e0-842f-8ae7a4438f89 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:51.990827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 479/959] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:51.998789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:52.105432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89088b-21ca-4fbb-bb31-f9a6bb1d0e46 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:52.139468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:52.140529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.141025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.141607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.142653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] RBAC: Adding query filter params (type=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:52.143174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:52.144762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0690e1a-1286-4e58-93d8-5e199754560d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:52.149936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 481/960] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:52.176760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f358-c3b8-4760-9217-92a4872c1ab7 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.177087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f358-c3b8-4760-9217-92a4872c1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.177319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f358-c3b8-4760-9217-92a4872c1ab7 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.179290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 480/961] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:52.185064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.185702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.186217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.205249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:52.206859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:52.283280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 482/962] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:52.306588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497f358-c3b8-4760-9217-92a4872c1ab7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:52.412101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497f358-c3b8-4760-9217-92a4872c1ab7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:52.445479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:52.446312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.446590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.446862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.457607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:43:52.465738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:52.466664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:52.467501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 481/963] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:43:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:52.477489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:52.577930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00f50a-2003-42c9-9cd5-ceea7b1a75c2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:52.614250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:52.615313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.615837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.616322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.617273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:52.617831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:52.619396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:52.628698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 483/964] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:43:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:52.635004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:52.740075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bed8-e750-4ef4-bccf-15ed9ee574ae None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:52.775660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:52.776444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.776719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.776985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.788101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:52.789515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:52.806765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:52.808555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:52.808555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:52.808555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:52.808555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:52.808555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 482/965] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:52.814339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:52.918664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea279-73a5-418d-815d-da4340b5bf49 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:52.953427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:52.954757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:52.955034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:52.955311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:52.956028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:52.956334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:52.957703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013861a-f238-4e60-9b8d-62cf481ff33b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:52.969748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 484/966] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:52.975177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.042434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2839c-afd4-4497-87fc-4bc2078fc7a5 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.042631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2839c-afd4-4497-87fc-4bc2078fc7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.042934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2839c-afd4-4497-87fc-4bc2078fc7a5 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.045552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 485/967] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:53.050290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.050573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.050857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.069837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:53.071514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:53.082893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf897a-67a7-4925-b946-32c40a054226 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.124642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.125966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.126256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.126537 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.136024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.137957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:53.155998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:53.157185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 14:43:53.158203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:53.158740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 486/969] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:53.158813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 483/969] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:43:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:53.164570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.178533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.277669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84ab2d-dc0e-49f1-9f80-0b0ac4812975 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.281411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c07dd-4375-4117-a7dd-5bde2577452d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.314007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.315174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.315465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.316020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.316876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:53.317339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.319593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.323613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.324618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.324973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.325326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.326097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.327897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.339242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 487/970] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:53.342376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:53.343358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:53.344190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 484/971] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:53.350234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.351883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.457560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459f8c-5558-4b9d-a61d-85b18b23781b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.474889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014040b-06c4-49b5-a926-887ef5dc5b04 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.491809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.492758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.493372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.493852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.494737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:53.495223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.496770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.502826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 485/972] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:53.508276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.511297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.512029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.513068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.513068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.580782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.582254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.632716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ace0-4527-4d78-99f2-a73eddc3a292 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.668767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.669538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.670048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.670188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.670978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:53.671323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.673329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.683075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 486/973] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:53.684464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.700883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 488/974] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:43:53.702080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.793149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0c2d-e572-4fb9-8346-2037e6ca2747 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.809707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299842-c904-4796-b6e0-87069b176506 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.829137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.829922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.830274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.830645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.831570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] RBAC: Adding query filter params (interface=admin, service_id=d3cf1024b50b4592a93b2d4052c870bc, region_id=RegionOne) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:53.831897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.833330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.843242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 487/975] 10.222.0.48 () {56 vars in 1249 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/endpoints?service_id=d3cf1024b50b4592a93b2d4052c870bc&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:53.844856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.847206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.848549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.849057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.849636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.860830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.862556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:43:53.880469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:53.881467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:53.882436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:43:53.882436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:43:53.882436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:43:53.882436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:53.889051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 489/976] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:53.890526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:53.948116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f30-6b92-4e1c-8337-6270c20ee026 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.981708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:53.982372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.982647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.982925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.983614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:53.985546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53128-aa16-49f2-95e3-0eba60ec4def None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:53.993835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 488/977] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:43:53.994003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b045d-4e3d-4a22-8904-5f4f25927c85 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:53.994086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bd60-bf71-44be-ae5a-b95f921e46f4 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:53.994086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bd60-bf71-44be-ae5a-b95f921e46f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:53.994086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bd60-bf71-44be-ae5a-b95f921e46f4 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:53.994622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 489/978] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:54.003443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.003713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.003992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.025566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:54.027121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:54.033938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.034961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.035461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.035912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.036830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:54.037139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.038560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.050879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 490/979] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:54.056352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.125535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 490/980] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:54.151132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.177136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7902fd-aadf-4fdf-9264-61f45e1c7de3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.220032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.220843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.221125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.221398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.228505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.229962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:43:54.244877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:54.245874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:54.246767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 491/981] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:54.252660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.272933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f6db9-7c7a-4f5f-b1ec-5f46e1f53da2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.318001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.319187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.320128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.320630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.321792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.324434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.343713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.sql.core [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 14:43:54.343713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 14:43:54.343713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [parameters: {'user_id': '5f634a020b96484988d42905936a7bf6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 14:43:54.343713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79832) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:43:54.355908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:43:54.356860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application yield resource May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application next(self.gen) May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.rollback() May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.force_reraise() May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise self.value May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application session.commit() May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 14:43:54.357885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._prepare_impl() May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.session.flush() May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._flush(objects) May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application compat.raise_( May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application flush_context.execute() May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rec.execute(self) May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 14:43:54.358790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = connection._execute_20( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 14:43:54.359676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result = self._query(query) May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application conn.query(q) May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application result.read() May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 14:43:54.360701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [parameters: {'user_id': '5f634a020b96484988d42905936a7bf6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:54.361540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 05 14:43:54.365631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 14:43:54.367833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.368603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de21a-33d8-4597-a9e2-85b8c6d12219 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.368756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 491/982] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 5 14:43:54 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:54.371150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.406705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.407826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.407826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.408112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.408846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:54.409227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.410596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.422608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 492/983] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:54.428674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.494768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0471d31-8bb8-4725-b1b4-86221de006da None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.530260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.531056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.531334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.531620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.540941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.543012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.556369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d4f8-fac7-480f-8106-55f6566304cc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-f1f284fb-7d63-47f8-8e55-a59f72af1863 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:43:54.559615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:54.560585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 14:43:54.561663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:54.566122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 492/984] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:43:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:54.567397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522a45-1c66-49ea-a707-d10b416f9a99 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.567682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522a45-1c66-49ea-a707-d10b416f9a99 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.567958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522a45-1c66-49ea-a707-d10b416f9a99 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.573504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 493/985] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:54.573504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522a45-1c66-49ea-a707-d10b416f9a99 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.591911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.592553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.592830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.593101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.593951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] RBAC: Adding query filter params (role.id=3f6dde19e19b4a09bf6cca4b2b28bc15, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b22700cae020412589e7bfdbb00e91bc) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:54.594259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.596147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74736-8ae7-4409-bea3-f873bd140736 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.601850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 493/986] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:43:54 2022] GET /identity/v3/role_assignments?user.id=b22700cae020412589e7bfdbb00e91bc&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:54.602852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.603135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.603410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.628637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:54.629922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:54.696312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522a45-1c66-49ea-a707-d10b416f9a99 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.710462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 494/987] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:54.733429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:54.745429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.746176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.746461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.747103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.748233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:54.748546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.751431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4400f6-724f-4868-b848-bd6868cf6302 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.798904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 494/988] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 5 14:43:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:54.851662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8899-9002-4da6-be22-1e4790183403 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:54.893995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:54.894728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:54.895010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:54.895285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:54.896030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:54.897446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954824c7-c92e-425f-b281-f99a7a6528c7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:54.916655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 495/989] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:54 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:43:56.338745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0c6c-5e28-4638-b64c-18bbad928748 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.339262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0c6c-5e28-4638-b64c-18bbad928748 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.339342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0c6c-5e28-4638-b64c-18bbad928748 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.340693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 495/990] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:56.345935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.346347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.346510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.363873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:56.365040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:56.445716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 496/991] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:56.467394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0c6c-5e28-4638-b64c-18bbad928748 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:56.566422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0c6c-5e28-4638-b64c-18bbad928748 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:56.598958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:56.599674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.599955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.600229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.600876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:56.602258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:56.614512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:56.615631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:56.616572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 496/992] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 5 14:43:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:43:56.623729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:56.717875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00844660-2c07-45a3-a50c-1ffeb4c98958 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:56.750336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:56.751124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.751442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.751785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.752511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:56.752822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:56.754279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:56.764444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 497/993] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:56.766786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:56.866051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442f2d-0acc-4be1-b2fb-9221270c0c9c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:56.899390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:56.899390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.899645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.899899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.900579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:56.900884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:56.905385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaeb3d-0093-4ef6-a36d-ccdc5934a773 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:56.915252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 497/994] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 5 14:43:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:56.916949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:56.950531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a55e6-38a0-44f1-8e14-41191e644d1e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.950834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a55e6-38a0-44f1-8e14-41191e644d1e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.951096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a55e6-38a0-44f1-8e14-41191e644d1e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.952592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 498/995] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:56.957848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:56.958173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:56.958774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:56.976666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:56.978200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:57.018292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c284b-30f2-442c-8d20-a375448fbc60 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.048412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 499/996] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:57.053680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.054530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.054815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.055087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.055817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.057170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cd47-383a-4c33-9ca8-262f533065f1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.071346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.081673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 498/997] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:43:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:43:57.179225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f66d-9c2a-40f0-bbb3-f9334918d686 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.210421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8ef1-e58d-4f38-940a-156df84b51fe None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.210762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8ef1-e58d-4f38-940a-156df84b51fe None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.210981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8ef1-e58d-4f38-940a-156df84b51fe None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.212352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 499/998] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:57.218164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.218500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.218720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.222966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.223764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.224041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.224310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] PATH_INFO: `/v3/services/image` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.224961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.226384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.236841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:57.238365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:57.239354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:43:57.240198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:43:57.240934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:57.241006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 500/999] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:57.245695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.316771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 500/1000] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:57.340509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.352350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb959-2116-4184-a9ef-da313fe74c9c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.385416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.386105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.386384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.386655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.387354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] RBAC: Adding query filter params (name=image) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:57.387661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.389003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.398875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 501/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:57.400777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.447146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51e2aa-561b-481a-a260-75a9039a0aa7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.486568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.487368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.487650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.487924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.488638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.490039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.498196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bd35-d088-4991-8a51-9b0170f8fff8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:43:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:43:57.503101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:43:57.508866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 501/1002] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:43:57.509842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.533871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.534551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.534825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.535101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.535799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] RBAC: Adding query filter params (type=image) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:57.536110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.537458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.553703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 502/1003] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:57.616697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bfc98-b8de-479e-83d5-11ddd800ef60 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.652417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.653098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.653377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.653666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.654386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:57.654690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.656140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.666276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 502/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:57.667375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.771511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fc1d9-58b3-47e8-950d-e812c344eb1e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.803655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.804320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.804604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.804877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.805578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] RBAC: Adding query filter params (type=compute) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:57.805919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.807266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.817181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 503/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:57.818737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:57.915448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3074ec-faaa-49d7-8f92-b295efc2508a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:57.948077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:57.948734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:57.949018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:57.949293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:57.950274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] RBAC: Adding query filter params (interface=public, service_id=523c2b6a5a2a465cbdede921bb7eebc2, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:43:57.950589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:57.951962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdacf07-fdfe-4351-83b2-13837fab40ec None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:57.962069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 503/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/endpoints?service_id=523c2b6a5a2a465cbdede921bb7eebc2&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:43:57.963635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:58.058852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368f8e-27da-42e4-ac79-dc258a3d6fdc None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:58.091129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:58.091785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:58.092066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:58.092338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:58.093007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:58.094515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7bdf-54fa-4c32-b8d5-d6135e12f8a4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:58.106572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 504/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:43:57 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:43:59.430587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be97bd-0983-41df-833d-8955610d2bb5 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.431032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be97bd-0983-41df-833d-8955610d2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.431410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be97bd-0983-41df-833d-8955610d2bb5 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.432989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 504/1008] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:43:59.438241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.438917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.439082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.455858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:59.457016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:59.525302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 505/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:43:59.550334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be97bd-0983-41df-833d-8955610d2bb5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:59.653351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be97bd-0983-41df-833d-8955610d2bb5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:59.687832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:59.689356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.689633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.689924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.691085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:59.692483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f4c3e-3224-4188-9970-36197b1158dd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:59.694249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 505/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:43:59.699901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:43:59.806272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e253a-8c9b-429a-8d61-e2b9e228facc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:43:59.819314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1ca7-eea6-45f8-858e-0a7f21ac746a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.819602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1ca7-eea6-45f8-858e-0a7f21ac746a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.819862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1ca7-eea6-45f8-858e-0a7f21ac746a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.821363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 506/1011] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:43:59.826348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825af2-1743-4ee9-af63-bcab938383ce None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.826638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825af2-1743-4ee9-af63-bcab938383ce None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.826917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825af2-1743-4ee9-af63-bcab938383ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.841950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:43:59.842608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:43:59.842892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:43:59.843166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:43:59.843875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:43:59.843974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d5825af2-1743-4ee9-af63-bcab938383ce None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:43:59.845866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d5825af2-1743-4ee9-af63-bcab938383ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:43:59.845978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:43:59.872489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 506/1012] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:59 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:43:59.916342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 507/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:43:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:43:59.939947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:00.043718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683d29-0695-40d1-9a29-c145b79d0ffd None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:00.077596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:00.078296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.079106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.079382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.080111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:00.081469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334cc4-b7f9-49f2-8d4a-41b7235a56c4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:00.096472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 507/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:43:59 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:00.418062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2bbb-2c30-4f17-bdc6-37e880c98e72 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.418435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2bbb-2c30-4f17-bdc6-37e880c98e72 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.418559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2bbb-2c30-4f17-bdc6-37e880c98e72 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.420057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 508/1015] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:00.425590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.426140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.426642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.444584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:00.446375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:00.517799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 508/1016] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:00.540859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2bbb-2c30-4f17-bdc6-37e880c98e72 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:00.636464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2bbb-2c30-4f17-bdc6-37e880c98e72 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:00.669135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:00.669864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.670305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.670586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.671225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:00.673099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:00.684238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:00.685215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 14:44:00.686103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:00.690664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 509/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:44:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:00.691881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:00.786108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed63a2-aa91-453f-9a12-7dc54ac5b196 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:00.818329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:00.818991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.819265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.819541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.820237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:00.820541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:00.821921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:00.832099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 509/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:44:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:00.833277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:00.928767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680111c-5e47-407c-b222-71bfa776698a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:00.962887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:00.963546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:00.963826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:00.964099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:00.964801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:00.965104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:00.966476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb39ffa-1438-49ae-85c7-4a694bfcd453 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:00.977326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 510/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 5 14:44:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:00.977497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:01.072165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78008-85ee-4da5-8dfa-e232f9586f29 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:01.106751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:01.107410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:01.107690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:01.107959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:01.108691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:01.110111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5e86d-791c-4f9e-a0c8-88903f718f2b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:01.128810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 510/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:44:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:02.260109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf4ed-f6fb-4ea7-8e03-a97bbb93bdac None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.260637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf4ed-f6fb-4ea7-8e03-a97bbb93bdac None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.260637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf4ed-f6fb-4ea7-8e03-a97bbb93bdac None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.262189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 511/1021] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:02.267508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e30525-a200-4066-82ee-2bb17fdc571f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.267938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e30525-a200-4066-82ee-2bb17fdc571f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.268127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e30525-a200-4066-82ee-2bb17fdc571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.285373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-39e30525-a200-4066-82ee-2bb17fdc571f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:02.286572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-39e30525-a200-4066-82ee-2bb17fdc571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:02.358127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 511/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:02.383707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdf4ed-f6fb-4ea7-8e03-a97bbb93bdac None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:02.397877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee2a-6e57-4016-ad5c-5d379b0cec7f None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.398170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee2a-6e57-4016-ad5c-5d379b0cec7f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.398450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee2a-6e57-4016-ad5c-5d379b0cec7f None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.399939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 512/1023] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:44:02.404588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.404882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.405334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.423752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:02.424919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:02.489518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdf4ed-f6fb-4ea7-8e03-a97bbb93bdac None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:02.496449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 513/1024] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:02.519394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:02.521536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:02.522371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.522648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.522915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.524079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:02.525510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:02.527131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 512/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:02.533029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:02.621434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d958-0a34-4128-b6d1-ae695885a66e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:02.633227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0694e-fbef-4ed5-ad5a-5e1e897b997e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:02.657392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:02.658206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.658480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.658757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] PATH_INFO: `/v3/services/image` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.659404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:02.660751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:02.666829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:02.667492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.667774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.668044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.668762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:02.670241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:02.672826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:02.673905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:02.674749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:02.677970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 514/1026] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 5 14:44:02 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:02.680160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:02.701675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 513/1027] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:44:02 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:44:02.804336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42712-9bbf-44a5-a464-1677ec48a968 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:02.841811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:02.842482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:02.842818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:02.843031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:02.843745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] RBAC: Adding query filter params (name=image) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:02.844132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:02.846774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:02.852245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 515/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:02.857931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:02.962803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8ba0-a674-4b37-b8ec-941182e6a78c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:03.004059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:03.004732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.005015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.005300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.006026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] RBAC: Adding query filter params (type=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:03.006333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:03.007696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:03.013194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 514/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:03.019075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:03.114949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511a9a-7731-4057-b416-c439a9533b8f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:03.147351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:03.148011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.148291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.148563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.149350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] RBAC: Adding query filter params (interface=public, service_id=fe89608579504b04a144fb0ed2287580, region_id=RegionOne) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:03.149681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:03.151023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13446-b74b-474b-829c-dec63ccd0f10 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:03.156164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 516/1030] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:44:03 2022] GET /identity/v3/endpoints?service_id=fe89608579504b04a144fb0ed2287580&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:03.162120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:03.256687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faf0d-60e3-41ce-8b1a-ecddeb7629fc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:03.288527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:03.289252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.289459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.289758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.290427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:03.291774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536de23-b692-4d21-9726-e2cc2c35ac5f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:03.305119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 515/1031] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:44:03 2022] GET /identity/v3/services => generated 1957 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:44:03.513458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c046-4b23-4647-991d-b6bda5fdfb0f None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.514023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c046-4b23-4647-991d-b6bda5fdfb0f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.514023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c046-4b23-4647-991d-b6bda5fdfb0f None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.515527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 517/1032] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:03.521372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.521746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.521968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.538813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:03.539981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:03.604857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 516/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:03.629284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c046-4b23-4647-991d-b6bda5fdfb0f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:03.730161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c046-4b23-4647-991d-b6bda5fdfb0f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:03.762064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:03.762860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.763139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.763410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.774959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:03.783533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:03.784475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:03.790311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 518/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:44:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:03.792490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:03.887387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32fffd-2739-4822-aa90-399102be79f2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:03.921881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:03.923455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:03.923455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:03.923734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:03.924463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:03.924768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:03.926152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:03.934069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 517/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:44:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:03.940118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.039712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2e58e-2446-4ae3-b03e-d32b1a60685c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:04.071830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:04.072621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:04.072870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:04.073134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:04.084155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:04.086286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:04.103505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:04.104432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:04.107039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:04.107039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:04.107039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:04.107039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:04.107039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 519/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:04.111242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.207021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299716-2381-4104-bc1e-ce38a4380d6e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:04.240069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:04.241053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:04.241538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:04.242046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:04.242983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:04.243454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:04.244952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:04.261386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 518/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:04.263098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.360038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cbb86-6452-4edf-98be-de7de1d37882 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:04.391820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:04.392599 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:04.392880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:04.393155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:04.400551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:04.402007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:44:04.416136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:04.417210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:04.423236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 520/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:44:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:04.425918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.525152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaf016-8600-4ea3-a581-23e01ae73012 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:04.559017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:04.559674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:04.559951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:04.560219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:04.561032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:04.561332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:04.562791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:04.584621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 519/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:44:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:04.585958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.681895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8c443-0b24-4eb1-8ada-1a210e1e4fbb None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:04.716225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:04.716875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:04.717155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:04.717425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:04.782078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:04.783519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe42c-1f8d-4572-b25d-18e31b0c3ec6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:04.884034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 521/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:04.889493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:04.987641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f227-1df4-467f-8ab0-0ded7c29c892 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.021162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.021978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.022258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.022597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.033048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ba4b-0640-4020-8408-5ec6b2b1986a None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.033338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ba4b-0640-4020-8408-5ec6b2b1986a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.033441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.033617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ba4b-0640-4020-8408-5ec6b2b1986a None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.034877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.035324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 522/1041] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:44:05.040155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.040445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.040744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:05.052827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:05.053776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:05.054715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:05.054715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:05.054715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:05.054715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:05.055697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 520/1042] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:05.059657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.059851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:05.061137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:05.133245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 523/1043] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:05.156427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.164840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df27a6e-3323-4610-ae19-8b2ae987ee33 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.199121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.199777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.200057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.200334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.201051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:05.201386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.202732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.214674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 521/1044] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:05.220856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.259912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9792d5-bac2-4519-bafb-21f4b16f5c00 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.293569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.294460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.294811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.295150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.305065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:05.313299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:05.314848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:05.315877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:05.322333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 524/1045] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:05.323127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.324276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a33227-c4b6-4cfd-a5f5-82e3fa5fbc3a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.358489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.359269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.360177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.360432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.366984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.368415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:44:05.382759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:05.383649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:05.384539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 522/1046] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:05.389689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.435956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb2b8-0c45-497d-a1c7-b4e5cc447372 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.472820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.473492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.473797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.474075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.474821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:05.475229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.476477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.490609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 525/1047] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:05.491376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.491948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b878-b1c5-4b6d-bf7b-bc586e531d4d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.527144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.527729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.528010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.528452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.530042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:05.530362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.531847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.547821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 523/1048] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:05.554471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.594404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7faf561-6cf4-4202-a797-1d8d111a806d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.627976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.628831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.629106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.629375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] PATH_INFO: `/v3/users/4d3871b050a14bd9924a0088f8dee2bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.643071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d3871b050a14bd9924a0088f8dee2bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.644511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d39cf-cd51-41d9-8eb5-4d49ccc954c8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.646232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 526/1049] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/users/4d3871b050a14bd9924a0088f8dee2bf => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:05.651998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3290-9c93-44cf-bedc-f4a2ef0aa493 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.652292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3290-9c93-44cf-bedc-f4a2ef0aa493 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.652598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3290-9c93-44cf-bedc-f4a2ef0aa493 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.653880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 527/1050] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:05.654578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3290-9c93-44cf-bedc-f4a2ef0aa493 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.658716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbde8c-1246-4858-8adb-f91dacfed094 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.693193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.693864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.694143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.694413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.695345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] RBAC: Adding query filter params (role.id=3f6dde19e19b4a09bf6cca4b2b28bc15, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:05.695654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.697049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b41c4-0d19-42b9-817e-dd697f4c591e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.702226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 524/1051] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:05.703998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.704808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.705128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.727702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:05.728932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:05.758022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3290-9c93-44cf-bedc-f4a2ef0aa493 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.799313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.799893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.800174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.800513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.802689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 525/1052] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:05.826401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.872510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.873998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.939138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95b3c-091f-425f-862b-fd4623fe3805 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:05.972483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:05.973271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:05.973555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:05.973857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] PATH_INFO: `/v3/services/image` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:05.974511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:05.975864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:05.979014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 528/1053] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:05.984437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:05.987972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:05.988985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:05.989897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 526/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:05.996824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:06.087711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4eed5-cfd9-4723-be6c-9e09e748eb79 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:06.095006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c51c-38a9-4be7-b9c1-c7144864749b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:06.124789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:06.126207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:06.126528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:06.126799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:06.128045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:06.128954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:06.129458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:06.129617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:06.130080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:06.130355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:06.131051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] RBAC: Adding query filter params (name=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:06.136054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:06.136172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 529/1055] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:06.136274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:06.136921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:06.140493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 527/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:06.146085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:06.242807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a1bd-afc8-43fd-a0bc-b30052407e51 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:06.243164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac4f0-ea86-4df5-ada5-233d23a66c07 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:06.275569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:06.276317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:06.276673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:06.277024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:06.277756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] RBAC: Adding query filter params (type=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:06.278069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:06.279418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:06.280917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:06.282170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:06.282614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:06.282754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:06.283536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=74db7ea5e5674485a222fad91b941abc, user.id=4d3871b050a14bd9924a0088f8dee2bf) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:06.283847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:06.285357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 528/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:06.285525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386cd64-3163-4949-ada9-ed44858a2671 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:06.290780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:06.301830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 530/1058] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:06 2022] GET /identity/v3/role_assignments?user.id=4d3871b050a14bd9924a0088f8dee2bf&scope.project.id=74db7ea5e5674485a222fad91b941abc&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:06.404294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c7f-d4ee-4f7a-8e2f-ee4e22fb011c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:06.444149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:06.445171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:06.445638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:06.446132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:06.447086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:06.448678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8bd55-ce3a-44ba-aea3-c1489e2bdab2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:06.481718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 529/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:44:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:44:07.999296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2285f-de5f-40f5-9c33-003029add523 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:07.999831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2285f-de5f-40f5-9c33-003029add523 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:07.999831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2285f-de5f-40f5-9c33-003029add523 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.001750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 531/1060] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:08.006916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.007336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.007526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.024462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:08.025631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:08.095545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 530/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:08.117976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2285f-de5f-40f5-9c33-003029add523 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.217267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2285f-de5f-40f5-9c33-003029add523 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.249704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.251160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.251436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.251708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.261527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:08.269806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:08.270746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:08.271679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:08.273984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 532/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:08.277043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.377024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99edf-7112-4125-9cbc-9a463efb968c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.411587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.412265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.412544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.412811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.413573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:08.413907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:08.415269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8640-cf86-4ba8-8700-94e2d7956101 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:08.423933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 531/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:08.429766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.530090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27141a-6278-4eff-8f64-b87d785cdb58 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.555284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522cde-d498-44d6-9589-8ee5956c7650 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.555694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522cde-d498-44d6-9589-8ee5956c7650 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.555960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522cde-d498-44d6-9589-8ee5956c7650 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.557519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 532/1064] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:44:08.565078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.565364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.565638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.568493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.569317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.569583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.569886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.582271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:08.583740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:08.583872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:08.585095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:08.601598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:08.602581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:08.603507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:08.603507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:08.603507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:08.603507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:08.603507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 533/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:08.608333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.662104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 533/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:08.682073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.710299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8486-4c3e-4544-abfc-112f67e8f2c6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.743009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.743664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.743942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.744213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.744925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:08.745229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:08.746615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b064-6d2c-4f63-b120-e124356c40da None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:08.759300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 534/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:08.760645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05184-4353-46a1-b6fb-f66360f53a2f None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.760932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05184-4353-46a1-b6fb-f66360f53a2f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.761206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05184-4353-46a1-b6fb-f66360f53a2f None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.764135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 535/1068] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:08.764755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce05184-4353-46a1-b6fb-f66360f53a2f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.782323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f561-89e3-4290-982a-4ab94d5c23dc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.815310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.816091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.816367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.816642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.826337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-77727a29-3608-4772-a6d6-2ff1b73b1873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:08.833776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:08.834901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:08.835761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:08.840162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 534/1069] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:08.841457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.841773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.842052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.858521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:08.860428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:08.861766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce05184-4353-46a1-b6fb-f66360f53a2f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:08.893797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:08.894565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:08.894839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:08.895106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] PATH_INFO: `/v3/users/nova` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:08.901873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:08.903276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:44:08.917230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:08.918294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 536/1070] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:08.919852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:08.923933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 535/1071] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:08.924758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.018343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e161ee-c58b-4d37-82ea-1bba0357ca47 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.024520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71627ad-e916-48bf-8a54-35fc9179d3da None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.050970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.051561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.051837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.052106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.052924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:09.053234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.054674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.059652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.060312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.060593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.060866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.061610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:09.061945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.063720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.071689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 536/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.071926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 537/1073] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.072516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.077389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.167110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6c30-7f8c-494e-82fd-d307189bd8f6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.169601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ce7a-bad6-4e2c-92e0-1c18658e9e53 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.199241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.199879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.200156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.200426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.201753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.202530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.202808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.203171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.213361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.214824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:09.231603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:09.232549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 537/1074] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:09.238936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.263483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.264904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.327155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff02a-5c1b-4c98-be0b-a42ca41b0aae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.359096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 538/1075] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:09.359480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.359957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.360401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.360606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.360875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] PATH_INFO: `/v3/users/4d3871b050a14bd9924a0088f8dee2bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.362094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] RBAC: Authorizing `identity:get_user(user_id=4d3871b050a14bd9924a0088f8dee2bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.363506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.365110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 538/1076] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/users/4d3871b050a14bd9924a0088f8dee2bf => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.365861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.455916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2aa49-0cd4-4c4f-adb4-9a7eb198b36d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.460389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a117-278e-4788-ac2d-22931b7547df None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.488564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.489224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.489502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.489807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.490520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:09.490825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.492170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.493564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.494366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.494643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.494912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.503590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 539/1077] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.504387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.505618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.507080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:09.526055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:09.527195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 539/1078] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:09.528168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.601163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb602-3de5-4ee1-b8a7-aeec55ae8078 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.623791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dcf37-ff4b-42ae-bb29-8ceb8f7bd670 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.633555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.634459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.634743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.635022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.636191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.637603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.639314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 540/1079] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.640061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.660376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.661156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.661434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.661733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.668254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.669703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:44:09.683900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:09.684834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 540/1080] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:09.685796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.736310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7efab-fe15-4adf-bd13-f3198e2de42f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.767985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.768642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.768926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.769199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.769946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:09.770259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.771605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.783111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 541/1081] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.783557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb11a-8443-4884-9b00-2474b01b190a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.783892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:09.821751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.822654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.822929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.823198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc/users/4d3871b050a14bd9924a0088f8dee2bf/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.826070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] RBAC: Authorizing `identity:create_grant(project_id=74db7ea5e5674485a222fad91b941abc, user_id=4d3871b050a14bd9924a0088f8dee2bf, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.827536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.842948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 541/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:44:09 2022] PUT /identity/v3/projects/74db7ea5e5674485a222fad91b941abc/users/4d3871b050a14bd9924a0088f8dee2bf/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:44:09.900960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61f1e4-2cc4-4656-a26e-0aa53f78b7c6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:09.940956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:09.941719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:09.942006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:09.942335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:09.943140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:09.943506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:09.945003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9e0d-ba53-45f8-9a74-c6949911318c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:09.963564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 542/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:09.965126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:10.077032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758225-a6dd-4d0f-9f59-47e0c6939269 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:10.112684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:10.113569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:10.113879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:10.114148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/3f6dde19e19b4a09bf6cca4b2b28bc15` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:10.116341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=b2f119b3cd5647b39942bdc91f95d8df, role_id=3f6dde19e19b4a09bf6cca4b2b28bc15)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:10.117800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161ebd-bd52-423d-8dfe-71a82b5fe9f7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:10.136344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 542/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:44:09 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/b2f119b3cd5647b39942bdc91f95d8df/roles/3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:44:12.099651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a89-06b8-4d83-b9bb-ac940a5b999e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.100221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a89-06b8-4d83-b9bb-ac940a5b999e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.100221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a89-06b8-4d83-b9bb-ac940a5b999e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.101544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 543/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:12.106824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.107225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.107379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.124370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:12.126634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:12.191567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 543/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:12.215630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932a89-06b8-4d83-b9bb-ac940a5b999e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.317025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932a89-06b8-4d83-b9bb-ac940a5b999e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.350903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.351602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.351907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.352180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.362755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a4705487-970a-43a1-935c-6424be43c058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:12.370178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:12.371134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:12.371993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 544/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:12.377626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.384920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680624a2-b51a-4ba6-b36a-946dedacc75d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.385207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680624a2-b51a-4ba6-b36a-946dedacc75d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.385480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680624a2-b51a-4ba6-b36a-946dedacc75d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.386852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 545/1088] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:44:12.392472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c5f95-770f-4066-9257-77228d594116 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.392752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c5f95-770f-4066-9257-77228d594116 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.393030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c5f95-770f-4066-9257-77228d594116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.412136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-946c5f95-770f-4066-9257-77228d594116 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:12.413311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-946c5f95-770f-4066-9257-77228d594116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:12.477974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 546/1089] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:12.479087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af3fa-6d24-4bd1-b7f3-dc89b0400177 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.502139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c5f95-770f-4066-9257-77228d594116 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.512334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.512991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.513266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.513535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.514297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:12.514600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:12.517009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:12.524941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 544/1090] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:12.530403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.597958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c5f95-770f-4066-9257-77228d594116 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.625926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613473a-9e1e-4c88-bb09-74705219218f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.629482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.630310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.630589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.630857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.640990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:12.649330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:12.650523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:12.651429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 547/1091] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:12.657023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.659129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.659983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.660257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.660525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] PATH_INFO: `/v3/users/4d3871b050a14bd9924a0088f8dee2bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.661718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] RBAC: Authorizing `identity:get_user(user_id=4d3871b050a14bd9924a0088f8dee2bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:12.663121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:12.664708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 545/1092] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/users/4d3871b050a14bd9924a0088f8dee2bf => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:12.670278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.750686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7d64-f210-41e6-941b-1bb5827e33d3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.764638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d6e52-d979-43fc-b28a-09457fe349da None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.782712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.783357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.783636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.783905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.784641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:12.784944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:12.786316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:12.794047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 548/1093] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:12.797372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.798135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.798420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.798698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.799535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.862840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:12.864262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:12.893228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155570-eab1-44eb-aa34-9f75bf3d505d None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:12.924558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:12.925331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:12.925612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:12.925916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:12.935869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:12.937290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:12.955235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:12.956164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:12.957068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:12.957068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:12.957068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:12.957068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:12.957068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 549/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:12.959213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 546/1095] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:12.961954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:12.964699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.056194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc9068-dbcf-4fce-9ed8-8a9a8a6ab5bf None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.057335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499fe4d-fbd7-4b99-8bc9-90ffb8fd4b07 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.089368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.090046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.090325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.090592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.090813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.091298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:13.091600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.091698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.091926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.092200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.092942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.093362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.094925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.096596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 547/1096] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:13.102778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.104248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 550/1097] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:13.109619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.195576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a00e-b425-4009-94fb-86afb663d0fa None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.206861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4200-c72e-41eb-92c0-730fcc7f76ed None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.227947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.228595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.228875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.229150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.229999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=74db7ea5e5674485a222fad91b941abc, user.id=4d3871b050a14bd9924a0088f8dee2bf) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:13.230309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.231726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.238211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 548/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/role_assignments?user.id=4d3871b050a14bd9924a0088f8dee2bf&scope.project.id=74db7ea5e5674485a222fad91b941abc&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:13.239040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.239817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.240097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.240374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.247847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.249312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:44:13.265595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:13.266992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:13.267956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 551/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:44:13.273178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.374188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022a37-b655-4ef2-bb47-2786639fe637 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.416374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.417044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.417322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.417593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.418449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:13.418753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.420191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.438973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 549/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:13.444532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.540860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cb7a3-3d1e-4dea-ac3b-1347f4ab9fa0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.573532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.574196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.574474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.574744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.638421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.639855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.732102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 552/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:13.738374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.831353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c263-bae5-43d7-9b74-f2abb8de1843 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:13.863543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:13.864312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:13.864589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:13.864857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:13.874281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:13.875724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:13.892264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:13.893353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:13.894281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:44:13.894281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:13.894281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:44:13.894281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:13.894281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 550/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:13.899167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:13.994468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6cca1-9dfd-41ea-a3dd-353ef66bbf1b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:14.026645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:14.027298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:14.027577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:14.027849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:14.028563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:14.028868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:14.030252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:14.041045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 553/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:14.047311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:14.142359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4f1f-2fb8-495f-a5b3-21028f8abf98 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:14.174603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:14.175380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:14.175661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:14.175936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:14.182336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:14.183758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:44:14.198004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:14.199418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:14.200324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 551/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:14.205140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:14.300335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535754f-26ba-4431-9ac2-83b18667f089 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:14.332800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:14.333453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:14.333769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:14.334048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:14.334824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:14.335134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:14.336547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1db22-135a-4abf-aaaf-b00956f3291e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:14.348738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 554/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:14.354885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:14.452726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5907-0ed6-4b1c-be16-ca3ec0eaebdf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:14.484574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:14.485315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:14.485600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:14.485899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:14.486717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] RBAC: Adding query filter params (role.id=3f6dde19e19b4a09bf6cca4b2b28bc15, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=b2f119b3cd5647b39942bdc91f95d8df) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:14.487029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:14.488444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300086dd-2a12-413e-b45c-2cffbfa854fb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:14.494009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 552/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:14 2022] GET /identity/v3/role_assignments?user.id=b2f119b3cd5647b39942bdc91f95d8df&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=3f6dde19e19b4a09bf6cca4b2b28bc15 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:15.525958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77718e-7fd0-4647-8342-9a8daf689716 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:15.526491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77718e-7fd0-4647-8342-9a8daf689716 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:15.526491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77718e-7fd0-4647-8342-9a8daf689716 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:15.527851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 555/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:15.533535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:15.533999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:15.534093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:15.550213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:15.551363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:15.613490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 553/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:15.637810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77718e-7fd0-4647-8342-9a8daf689716 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:15.733768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77718e-7fd0-4647-8342-9a8daf689716 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:15.764900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:15.766275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:15.766562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:15.766804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:15.767946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:15.769343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e34a-a5c2-46c9-ba52-8aca37146222 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:15.770951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 556/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:15.776553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:15.869190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ab82-1752-49ec-bf77-36c494d7bd9e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:15.901190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:15.901868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:15.902153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:15.902428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:15.903120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:15.904531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122430-52dc-404a-ae32-c22d267c182b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:15.923362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 554/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:44:15 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:18.188704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a76c3-1dd0-443b-8967-c837e386554d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.189295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a76c3-1dd0-443b-8967-c837e386554d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.189295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a76c3-1dd0-443b-8967-c837e386554d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.190708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 557/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:18.195743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.196179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.196280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.213071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:18.214257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:18.275844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 555/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:18.299959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a76c3-1dd0-443b-8967-c837e386554d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:18.396667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a76c3-1dd0-443b-8967-c837e386554d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:18.427335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:18.428171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.428445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.428720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] PATH_INFO: `/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.430194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] RBAC: Authorizing `identity:get_role(role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:18.431540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:18.432981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 558/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:18 2022] GET /identity/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:18.439893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:18.531041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430d89-175e-461d-8f95-4baa3ab4edbb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:18.562463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:18.563307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.563839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.564111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] PATH_INFO: `/v3/users/e90b174d27ba47d3919054a684009677` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.576254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=e90b174d27ba47d3919054a684009677)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:18.578225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:18.579985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 556/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:18 2022] GET /identity/v3/users/e90b174d27ba47d3919054a684009677 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:18.585848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:18.677509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dac3-0b13-4403-a5f5-3fd0e98cafb8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:18.709070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:18.709634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.709944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.710213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.771883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:18.773284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:18.864041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 559/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:18.869935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:18.962204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0518e-0708-4731-9da1-befd25763ac2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:18.993287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:18.994146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:18.994425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:18.994695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:18.995840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:18.997239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19962-d129-4472-98f3-6fb37cac8604 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:18.998899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 557/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:18 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:19.005980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:19.107740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3fc9-e99a-4e1e-bc67-89e61f6d3c5c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:19.140172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:19.141501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:19.141810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:19.142086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:19.142893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=74db7ea5e5674485a222fad91b941abc, user.id=e90b174d27ba47d3919054a684009677) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:19.143202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:19.144596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5a6e-0c11-44fe-a780-a1ca259351e6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:19.150015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 560/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:19 2022] GET /identity/v3/role_assignments?user.id=e90b174d27ba47d3919054a684009677&scope.project.id=74db7ea5e5674485a222fad91b941abc&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:21.360050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002723f-e9ec-4040-a52e-5a533c2dc8be None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:21.360587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002723f-e9ec-4040-a52e-5a533c2dc8be None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:21.360587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002723f-e9ec-4040-a52e-5a533c2dc8be None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:21.361969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 558/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:21.367303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:21.367720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:21.367858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:21.385155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:21.386334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:21.448739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 561/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:21.472135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002723f-e9ec-4040-a52e-5a533c2dc8be None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:21.567679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002723f-e9ec-4040-a52e-5a533c2dc8be None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:21.598718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:21.599542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:21.599812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:21.600079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] PATH_INFO: `/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:21.601496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] RBAC: Authorizing `identity:get_role(role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:21.602859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:21.604246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 559/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:21 2022] GET /identity/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:21.610721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:21.701799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4afc-3abe-4227-bec0-b06fff485879 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:21.732979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:21.734518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:21.734834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:21.735110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] PATH_INFO: `/v3/users/e90b174d27ba47d3919054a684009677` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:21.736290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] RBAC: Authorizing `identity:get_user(user_id=e90b174d27ba47d3919054a684009677)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:21.737751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:21.739352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 562/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:21 2022] GET /identity/v3/users/e90b174d27ba47d3919054a684009677 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:21.744949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:21.838438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1f8ba-bdaa-4b54-8deb-8596d7c51e16 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:21.870311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:21.871080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:21.871362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:21.871637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:21.872796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:21.874223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984bee-9830-41f1-9e6d-e8275edf1f6d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:21.876688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 560/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:21 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:21.882674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:21.976165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774b21-1638-4a25-8334-8813fc0e1fda None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:22.007904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:22.008771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:22.009050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:22.009321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc/users/e90b174d27ba47d3919054a684009677/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:22.011514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] RBAC: Authorizing `identity:create_grant(project_id=74db7ea5e5674485a222fad91b941abc, user_id=e90b174d27ba47d3919054a684009677, role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:22.012915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2770-a099-4283-8ac6-13810421a1ee None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:22.025736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 563/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:44:21 2022] PUT /identity/v3/projects/74db7ea5e5674485a222fad91b941abc/users/e90b174d27ba47d3919054a684009677/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:44:24.275842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661efe4-5376-4281-9dec-a7c0bf15d9a1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:24.276382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661efe4-5376-4281-9dec-a7c0bf15d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:24.276382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661efe4-5376-4281-9dec-a7c0bf15d9a1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:24.277752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 561/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:24.283420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:24.283860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:24.283978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:24.300779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:24.301983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:24.365200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 564/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:24.388516 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661efe4-5376-4281-9dec-a7c0bf15d9a1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:24.485272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661efe4-5376-4281-9dec-a7c0bf15d9a1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:24.518008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:24.518845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:24.519122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:24.519394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] PATH_INFO: `/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:24.520840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] RBAC: Authorizing `identity:get_role(role_id=96c296ae09d045b9b2d88c3048b2b3d7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:24.522227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:24.523559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 562/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:24 2022] GET /identity/v3/roles/96c296ae09d045b9b2d88c3048b2b3d7 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:24.529402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:24.624365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de766752-ae41-4ac2-a41b-b002db5c5c73 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:24.656870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:24.657739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:24.658025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:24.658302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] PATH_INFO: `/v3/users/e90b174d27ba47d3919054a684009677` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:24.659474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] RBAC: Authorizing `identity:get_user(user_id=e90b174d27ba47d3919054a684009677)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:24.660891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:24.662523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 565/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:24 2022] GET /identity/v3/users/e90b174d27ba47d3919054a684009677 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:24.668198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:24.771196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022183e-3143-4387-8867-d78de339b6e2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:24.802826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:24.803395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:24.803668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:24.803937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:24.872233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:24.873664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:24.964525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 563/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:24.970867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:25.063811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df619715-d0af-4d12-a302-d8e81eca90ad None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:25.095280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:25.096113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:25.096392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:25.096666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] PATH_INFO: `/v3/projects/74db7ea5e5674485a222fad91b941abc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:25.097842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] RBAC: Authorizing `identity:get_project(project_id=74db7ea5e5674485a222fad91b941abc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:25.099239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f67848-3377-484c-af2a-d238a6759758 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:25.100876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 566/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:24 2022] GET /identity/v3/projects/74db7ea5e5674485a222fad91b941abc => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:25.106799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:25.199809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e418de-433c-47c4-9650-1f2ec3c6a161 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:25.231353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:25.231990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:25.232269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:25.232541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:25.233350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] RBAC: Adding query filter params (role.id=96c296ae09d045b9b2d88c3048b2b3d7, scope.project.id=74db7ea5e5674485a222fad91b941abc, user.id=e90b174d27ba47d3919054a684009677) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:25.233680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:25.235723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3524ad8-29dc-43e4-b7e5-af1f844000bd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:25.241147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 564/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:25 2022] GET /identity/v3/role_assignments?user.id=e90b174d27ba47d3919054a684009677&scope.project.id=74db7ea5e5674485a222fad91b941abc&role.id=96c296ae09d045b9b2d88c3048b2b3d7 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:27.519609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea947e2-d67b-41b3-9675-c7b503a3fce3 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:27.520103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea947e2-d67b-41b3-9675-c7b503a3fce3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:27.520190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea947e2-d67b-41b3-9675-c7b503a3fce3 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:27.521491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 567/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:27.526508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:27.526918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:27.527064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:27.544202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:27.545379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:27.608561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 565/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:27.632774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea947e2-d67b-41b3-9675-c7b503a3fce3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:27.730240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea947e2-d67b-41b3-9675-c7b503a3fce3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:27.762398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:27.763162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:27.763441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:27.763712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:27.764883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:27.766495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3cee8-e809-40da-9d4e-86477244f500 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:27.768071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 568/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:27.773761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:27.866348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521475f7-98c7-420d-b9fe-77dbc7bb927e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:27.897639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:27.898304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:27.898581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:27.898856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:27.899554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:27.900975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2c4b0-68c1-4495-a115-aba8cfd56c33 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:27.926274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 566/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:44:27 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:44:30.200822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd916-cdfa-4eeb-b0d6-802858d23340 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:30.201358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd916-cdfa-4eeb-b0d6-802858d23340 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:30.201358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd916-cdfa-4eeb-b0d6-802858d23340 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:30.202787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 569/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:30.208177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:30.208625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:30.208722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:30.226318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:30.227468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:30.291237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 567/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:30.317629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cd916-cdfa-4eeb-b0d6-802858d23340 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:30.412959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cd916-cdfa-4eeb-b0d6-802858d23340 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:30.445625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:30.446421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:30.446693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:30.446956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:30.448113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:30.449519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea4fb9-8cc7-4c11-9da2-f766785f4f67 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:30.451177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 570/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:30.457069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:30.550024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35a18-438d-4147-88b4-dee05c56b285 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:30.581746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:30.582400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:30.582678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:30.582948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:30.583654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:30.585062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3829c-5797-4287-aaeb-400e35f382c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:30.604490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 568/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:44:30 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:32.904058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90b72-c563-4b08-899e-0f371951ed40 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:32.904567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90b72-c563-4b08-899e-0f371951ed40 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:32.904567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90b72-c563-4b08-899e-0f371951ed40 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:32.905980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 571/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:32.911842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:32.912238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:32.912394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:32.928534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:32.929716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:32.991873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 569/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:33.015703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90b72-c563-4b08-899e-0f371951ed40 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.112034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90b72-c563-4b08-899e-0f371951ed40 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:33.144265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:33.145028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:33.145308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:33.145581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:33.155082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:33.162587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:33.163671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:33.164683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 572/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:33.169779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.261499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62694a0-99ba-4393-a3ed-8c8e3453fcf3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:33.292963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:33.293611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:33.293921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:33.294194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:33.294924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:33.295228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:33.296618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:33.304145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 570/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:33.309912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.405255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad01c05-0949-4b08-89ab-225388704eaa None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:33.437442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:33.438309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:33.438846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:33.439113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] PATH_INFO: `/v3/users/70a5894ec9d74d8788e764792f70185c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:33.451607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] RBAC: Authorizing `identity:get_user(user_id=70a5894ec9d74d8788e764792f70185c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:33.453796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:33.455413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 573/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/users/70a5894ec9d74d8788e764792f70185c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:33.461099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.555054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4e69-899e-4994-a0a3-7b0a2ba7071e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:33.588226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:33.588861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:33.589140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:33.589410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:33.651922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:33.653353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:33.745498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 571/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:33.752090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.845345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57eb2-eb2f-41ba-b690-8dcfcd14017e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:33.877446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:33.878308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:33.878588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:33.878859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] PATH_INFO: `/v3/projects/3a96f3cfa5274d938b7c42bee294298f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:33.880007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3a96f3cfa5274d938b7c42bee294298f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:33.881404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fecf9-3db5-4119-ada0-6198822994e2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:33.883085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 574/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/projects/3a96f3cfa5274d938b7c42bee294298f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:33.889001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:33.985511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d61c-896f-4974-b782-37874974dc30 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:34.016561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:34.017132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:34.017406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:34.017702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:34.018508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=3a96f3cfa5274d938b7c42bee294298f, user.id=70a5894ec9d74d8788e764792f70185c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:34.018813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:34.020213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cd6f4-3f68-4b32-b8cb-708a4606daee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:34.025214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 572/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:33 2022] GET /identity/v3/role_assignments?user.id=70a5894ec9d74d8788e764792f70185c&scope.project.id=3a96f3cfa5274d938b7c42bee294298f&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:36.239884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78f67-42e3-49d6-90c2-9dc07b9ccd53 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.240423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78f67-42e3-49d6-90c2-9dc07b9ccd53 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.240423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78f67-42e3-49d6-90c2-9dc07b9ccd53 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.241834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 575/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:36.247183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.247603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.247716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.264264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:36.266073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:36.328740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 573/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:36.351479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa78f67-42e3-49d6-90c2-9dc07b9ccd53 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:36.448090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa78f67-42e3-49d6-90c2-9dc07b9ccd53 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:36.480819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:36.481594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.481894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.482166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.492324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:36.500472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:36.501554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:36.502610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 576/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:36.507846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:36.599141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1e4bb-7a18-4435-a96e-b5aaa0d45949 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:36.630076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:36.630722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.630998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.631269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.631997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:36.632301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:36.633680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:36.642000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 574/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:36.648499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:36.742256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159f9d-6fe4-4e22-a3e0-53514b319a04 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:36.773316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:36.774124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.774405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.774677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] PATH_INFO: `/v3/users/70a5894ec9d74d8788e764792f70185c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.775840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] RBAC: Authorizing `identity:get_user(user_id=70a5894ec9d74d8788e764792f70185c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:36.777240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:36.778843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 577/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:36 2022] GET /identity/v3/users/70a5894ec9d74d8788e764792f70185c => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:36.785363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:36.879344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88da86-e46e-4828-8f87-09001683a60f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:36.910760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:36.911595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:36.911874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:36.912147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] PATH_INFO: `/v3/projects/3a96f3cfa5274d938b7c42bee294298f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:36.913297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] RBAC: Authorizing `identity:get_project(project_id=3a96f3cfa5274d938b7c42bee294298f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:36.914720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84821e-69d8-42b1-af44-9a1469393f6e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:36.916362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 575/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:36 2022] GET /identity/v3/projects/3a96f3cfa5274d938b7c42bee294298f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:44:36.922593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:37.015718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aa222-65ef-4eb8-862f-7cdab2ba39da None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:37.048491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:37.049278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:37.049556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:37.049851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] PATH_INFO: `/v3/projects/3a96f3cfa5274d938b7c42bee294298f/users/70a5894ec9d74d8788e764792f70185c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:37.051748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a96f3cfa5274d938b7c42bee294298f, user_id=70a5894ec9d74d8788e764792f70185c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:37.053145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e19a-a902-471e-a952-9f23b07999d9 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:37.066792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 578/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:44:36 2022] PUT /identity/v3/projects/3a96f3cfa5274d938b7c42bee294298f/users/70a5894ec9d74d8788e764792f70185c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:44:39.444570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122fb3-121a-404a-9d69-8fee0378f7dd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:39.445038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122fb3-121a-404a-9d69-8fee0378f7dd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:39.445128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122fb3-121a-404a-9d69-8fee0378f7dd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:39.446521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 576/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:39.452699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:39.453113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:39.453250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:39.469671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:39.470863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:39.533227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 579/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:39.557058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db122fb3-121a-404a-9d69-8fee0378f7dd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:39.654875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db122fb3-121a-404a-9d69-8fee0378f7dd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:39.687620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:39.688566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:39.688847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:39.689114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:39.698585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:39.711122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:39.712329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:39.713212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 577/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:39.719781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:39.811168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317065b-6578-4a38-8114-b21ea02709a1 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:39.843053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:39.843693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:39.843972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:39.844246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:39.844981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:39.845287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:39.846672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:39.854255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 580/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:39.860608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:39.954274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a043d-700d-4b4a-8473-3fbdf15de5c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:39.985327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:39.986189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:39.986467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:39.986736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] PATH_INFO: `/v3/users/70a5894ec9d74d8788e764792f70185c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:39.987886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] RBAC: Authorizing `identity:get_user(user_id=70a5894ec9d74d8788e764792f70185c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:39.989289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:39.990881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 578/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:39 2022] GET /identity/v3/users/70a5894ec9d74d8788e764792f70185c => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:39.996373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:40.091183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e98241-c604-418c-b844-3292be2648e2 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:40.121820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:40.122442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:40.122721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:40.122994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:40.185135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:40.187129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:40.279475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 581/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:40.285499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:40.378518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfbebc-210a-424c-994b-6d5edf485059 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:40.410413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:40.411239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:40.411515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:40.411785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] PATH_INFO: `/v3/projects/3a96f3cfa5274d938b7c42bee294298f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:40.412935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] RBAC: Authorizing `identity:get_project(project_id=3a96f3cfa5274d938b7c42bee294298f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:40.414371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f436b10-04db-49e1-bc81-f6e701802397 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:40.416003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 579/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:40 2022] GET /identity/v3/projects/3a96f3cfa5274d938b7c42bee294298f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:40.422136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:40.513782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a0c73-4738-4e8b-b3ec-c912e198e871 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:40.546493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:40.547065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:40.547343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:40.547616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:40.548426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=3a96f3cfa5274d938b7c42bee294298f, user.id=70a5894ec9d74d8788e764792f70185c) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:40.548735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:40.550170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f7a3-f94e-4c83-a4a8-193dba2f22de None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:40.555786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 582/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:40 2022] GET /identity/v3/role_assignments?user.id=70a5894ec9d74d8788e764792f70185c&scope.project.id=3a96f3cfa5274d938b7c42bee294298f&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:42.817862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35db9-6a23-4a66-b0f2-50f43ef9f64e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:42.818361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35db9-6a23-4a66-b0f2-50f43ef9f64e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:42.818361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35db9-6a23-4a66-b0f2-50f43ef9f64e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:42.819647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 580/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:42.824694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:42.825117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:42.825251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:42.841389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:42.842694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:42.905608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 583/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:42.928119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35db9-6a23-4a66-b0f2-50f43ef9f64e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:43.023495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35db9-6a23-4a66-b0f2-50f43ef9f64e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:43.056152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:43.056776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:43.057054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:43.057321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:43.121628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:43.123032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:43.212726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 581/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:43.219902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:43.312645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d695cc-8093-42c5-9532-8e0018b00c84 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:43.345360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:43.346170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:43.346452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:43.346725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:43.353026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:43.354463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7b9f99e9-0475-4be1-bd6f-779e4e0b1e52 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:43.368188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:43.369466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:44:43.370843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 584/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:44:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:43.375422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:43.468036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ad6-0835-4166-8094-4b44e7ae321f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:43.499349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:43.499992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:43.500266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:43.500538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:43.501235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:43.501534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:43.502914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3a7d-f5a0-43fb-8d87-cbaf5acdd890 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:43.509668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 582/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 5 14:44:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:45.705142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d197a-c272-4d03-a5b4-d9d797114b1b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:45.705681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d197a-c272-4d03-a5b4-d9d797114b1b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:45.705681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d197a-c272-4d03-a5b4-d9d797114b1b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:45.707037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 585/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:45.712174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8182b-42dd-4751-b4c6-a3bc60741583 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:45.712586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8182b-42dd-4751-b4c6-a3bc60741583 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:45.712721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8182b-42dd-4751-b4c6-a3bc60741583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:45.730027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-72b8182b-42dd-4751-b4c6-a3bc60741583 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:45.731185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-72b8182b-42dd-4751-b4c6-a3bc60741583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:45.793316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 583/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:45.816073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d197a-c272-4d03-a5b4-d9d797114b1b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:45.912512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d197a-c272-4d03-a5b4-d9d797114b1b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:45.943899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:45.944528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:45.944806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:45.945077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:45.945813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:45.947223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09da4f-5440-4267-a49b-1c7efc78a5bd None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:45.961027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 586/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu May 5 14:44:45 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:48.208594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c736-feed-4640-a27a-20f30e48b7dc None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:48.209144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c736-feed-4640-a27a-20f30e48b7dc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:48.209144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c736-feed-4640-a27a-20f30e48b7dc None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:48.210656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 584/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:48.215768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:48.216152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:48.216326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:48.233727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:48.234891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:48.296653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 587/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:48.320046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c736-feed-4640-a27a-20f30e48b7dc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:48.415646 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c736-feed-4640-a27a-20f30e48b7dc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:48.448154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:48.448999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:48.449276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:48.449544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] PATH_INFO: `/v3/domains/e2379ac474b045149b9e382a537e6e2d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:48.459866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2379ac474b045149b9e382a537e6e2d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:48.461235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0f2e7-90c0-43f7-9982-178e3b285bda None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:48.462844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 585/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 5 14:44:48 2022] GET /identity/v3/domains/e2379ac474b045149b9e382a537e6e2d => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:48.469150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:48.561437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d096-ed31-4dd4-b2c5-a219e679279c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:48.594025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:48.594661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:48.594941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:48.595214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:48.595909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:48.597317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b22c-68e9-485a-9ff2-cc010554c6e2 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:48.620762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 588/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:44:48 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:50.888819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ed2a8-560e-4c8d-9bdd-9d1556c0f827 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:50.889417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ed2a8-560e-4c8d-9bdd-9d1556c0f827 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:50.889417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ed2a8-560e-4c8d-9bdd-9d1556c0f827 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:50.890734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 586/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:50.895835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:50.896269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:50.896405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:50.912668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:50.913878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:50.977215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 589/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:44:51.002504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ed2a8-560e-4c8d-9bdd-9d1556c0f827 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:51.097454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ed2a8-560e-4c8d-9bdd-9d1556c0f827 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:51.129073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:51.129928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:51.130205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:51.130473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] PATH_INFO: `/v3/domains/e2379ac474b045149b9e382a537e6e2d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:51.131622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2379ac474b045149b9e382a537e6e2d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:51.133023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f497550-df6c-4d12-bcd0-fd6b089f7875 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:51.134611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 587/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 5 14:44:51 2022] GET /identity/v3/domains/e2379ac474b045149b9e382a537e6e2d => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:51.140466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:51.233892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a87dd-a04a-4769-9aae-3f3efbc9c532 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:51.265355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:51.266035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:51.266319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:51.266592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:51.267288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:51.268699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179c248-b182-4a8f-a89e-68ab2d85f625 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:51.287771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 590/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:44:51 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:44:53.547728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c9ac-b2a0-4894-afca-402c933ede87 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:53.548266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c9ac-b2a0-4894-afca-402c933ede87 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:53.548266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c9ac-b2a0-4894-afca-402c933ede87 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:53.549595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 588/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:53.554879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:53.555292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:53.555418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:53.572522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:53.573700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:53.636138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 591/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:53.659684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c9ac-b2a0-4894-afca-402c933ede87 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:53.756813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c9ac-b2a0-4894-afca-402c933ede87 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:53.788180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:53.788943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:53.789218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:53.789488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:53.799868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:53.807260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:53.808393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:53.809465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 589/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:53.815149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:53.908986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aeb95-cb61-40f0-b259-ce40396e2918 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:53.940793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:53.941441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:53.941749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:53.942028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:53.942761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:53.943073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:53.944431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:53.952759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 592/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:53.958541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:54.053180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca09dc-8477-43d3-921b-1a37a709f153 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:54.085141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:54.086007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:54.086280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:54.086545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] PATH_INFO: `/v3/users/8de0b2b1bc724219a85c414e5dc38a69` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:54.099783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] RBAC: Authorizing `identity:get_user(user_id=8de0b2b1bc724219a85c414e5dc38a69)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:54.101203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:54.102813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 590/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:53 2022] GET /identity/v3/users/8de0b2b1bc724219a85c414e5dc38a69 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:54.108489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:54.203818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485943-c2c2-42e6-864c-e37c6a975fed None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:54.235003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:54.235626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:54.235903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:54.236174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:54.299809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:54.301217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:54.394403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:44:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:44:54.400113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:54.494164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97534b84-9916-4e22-a6e3-05ca340ecded None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:54.525453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:54.526314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:54.526591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:54.526856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] PATH_INFO: `/v3/projects/853091593512489ebe3748f02cd2054c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:54.528013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] RBAC: Authorizing `identity:get_project(project_id=853091593512489ebe3748f02cd2054c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:54.529457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e35ca0-c444-4214-8e5b-c6cd44ee32b8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:54.531275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 591/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:54 2022] GET /identity/v3/projects/853091593512489ebe3748f02cd2054c => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:54.537285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:54.631760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622178-7afb-4984-af5a-0b3e48904f64 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:54.663514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:54.664082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:54.664358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:54.664629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:54.665431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=853091593512489ebe3748f02cd2054c, user.id=8de0b2b1bc724219a85c414e5dc38a69) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:54.665765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:54.667160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6cda-a7f4-461b-aba4-50f0bec0616e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:54.673306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 594/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:44:54 2022] GET /identity/v3/role_assignments?user.id=8de0b2b1bc724219a85c414e5dc38a69&scope.project.id=853091593512489ebe3748f02cd2054c&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:56.887715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a59d-2493-487d-86ee-7d8b9bc90cbb None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:56.888236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a59d-2493-487d-86ee-7d8b9bc90cbb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:56.888236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a59d-2493-487d-86ee-7d8b9bc90cbb None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:56.889581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 592/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:56.894770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:56.895166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:56.895311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:56.911627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:56.912783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:44:56.975844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 595/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:44:56.999382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93a59d-2493-487d-86ee-7d8b9bc90cbb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:57.095259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93a59d-2493-487d-86ee-7d8b9bc90cbb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:57.126979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:57.127746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:57.128024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:57.128298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:57.137862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:44:57.145895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:44:57.146852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:44:57.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 593/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:44:57.153099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:57.245087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087f6ea-d5d0-45ba-ab9e-951af567e2e5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:57.276962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:57.277606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:57.277911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:57.278184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:57.278915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:44:57.279219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:57.280831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:57.288495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 596/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:57.295325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:57.388463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393d532-d5b2-46f5-a16b-01f1e24b7268 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:57.421278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:57.422155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:57.422431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:57.422699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] PATH_INFO: `/v3/users/8de0b2b1bc724219a85c414e5dc38a69` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:57.423845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] RBAC: Authorizing `identity:get_user(user_id=8de0b2b1bc724219a85c414e5dc38a69)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:57.425246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:57.427051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 594/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:44:57 2022] GET /identity/v3/users/8de0b2b1bc724219a85c414e5dc38a69 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:57.432595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:57.528014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095013-984d-4fb9-9ade-fcc1f3cbe3e8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:57.558872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:57.559707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:57.559981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:57.560247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] PATH_INFO: `/v3/projects/853091593512489ebe3748f02cd2054c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:57.562361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] RBAC: Authorizing `identity:get_project(project_id=853091593512489ebe3748f02cd2054c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:57.564024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33ef2-95c5-43b3-b90b-ec2506162e5c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:57.565691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 597/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:44:57 2022] GET /identity/v3/projects/853091593512489ebe3748f02cd2054c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:44:57.571509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:44:57.663611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9512e28-7bd7-41e7-b898-4adcc51ee46b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:44:57.695251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:44:57.696111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:57.696390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:57.696662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] PATH_INFO: `/v3/projects/853091593512489ebe3748f02cd2054c/users/8de0b2b1bc724219a85c414e5dc38a69/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:57.698602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] RBAC: Authorizing `identity:create_grant(project_id=853091593512489ebe3748f02cd2054c, user_id=8de0b2b1bc724219a85c414e5dc38a69, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:44:57.700011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a3c1-2829-4914-a1fd-57cafeeaf5ab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:44:57.711945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 595/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:44:57 2022] PUT /identity/v3/projects/853091593512489ebe3748f02cd2054c/users/8de0b2b1bc724219a85c414e5dc38a69/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:44:59.911591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b6dd-adae-42d0-91e5-1eb0d84c9640 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:59.912091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b6dd-adae-42d0-91e5-1eb0d84c9640 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:59.912091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b6dd-adae-42d0-91e5-1eb0d84c9640 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:59.913372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 598/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:44:59.918431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:44:59.918832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:44:59.918977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:44:59.936099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:44:59.937247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:45:00.001557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 596/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:45:00.024793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b6dd-adae-42d0-91e5-1eb0d84c9640 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.120847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b6dd-adae-42d0-91e5-1eb0d84c9640 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:00.151738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:00.152502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:00.152778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:00.153046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:00.163554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:45:00.171362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:45:00.172445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:45:00.173356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 599/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:45:00.178368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.271445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e042b-16d4-4fd1-af81-722769c6f53a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:00.302804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:00.303452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:00.303734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:00.304009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:00.304737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:45:00.305074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:45:00.306452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:45:00.315474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 597/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:45:00.321062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.415374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086ced-f3b3-4b0f-87a3-6ce82ec4a466 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:00.448022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:00.448871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:00.449153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:00.449428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] PATH_INFO: `/v3/users/8de0b2b1bc724219a85c414e5dc38a69` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:00.450634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] RBAC: Authorizing `identity:get_user(user_id=8de0b2b1bc724219a85c414e5dc38a69)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:45:00.452616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:45:00.454240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 600/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/users/8de0b2b1bc724219a85c414e5dc38a69 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:45:00.459854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.553532 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e7c2-58ee-4968-8584-c4af22229906 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:00.585018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:00.585659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:00.585946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:00.586217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:00.648774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:45:00.650217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:45:00.742075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 598/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:45:00.748129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.840888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c64d-20cf-4cbd-a39b-c367073278d8 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:00.872594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:00.874054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:00.874335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:00.874604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] PATH_INFO: `/v3/projects/853091593512489ebe3748f02cd2054c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:00.875767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] RBAC: Authorizing `identity:get_project(project_id=853091593512489ebe3748f02cd2054c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:45:00.877161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6777ba-6719-4ac3-af21-770b23138343 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:45:00.878828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 601/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/projects/853091593512489ebe3748f02cd2054c => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:45:00.884868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:45:00.978071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9abc-b8a8-466a-af08-2c30d808dfb5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:45:01.009874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:45:01.010452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:45:01.010734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:45:01.011007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:45:01.011816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=853091593512489ebe3748f02cd2054c, user.id=8de0b2b1bc724219a85c414e5dc38a69) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:45:01.012129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:45:01.013593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa4210-f534-46ac-a409-d14099b4a1c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:45:01.019124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 599/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:45:00 2022] GET /identity/v3/role_assignments?user.id=8de0b2b1bc724219a85c414e5dc38a69&scope.project.id=853091593512489ebe3748f02cd2054c&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:02.402155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c999f-1ac3-4b41-bbcb-11671550c4d5 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:02.402155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c999f-1ac3-4b41-bbcb-11671550c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:02.402155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c999f-1ac3-4b41-bbcb-11671550c4d5 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:02.402155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 602/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:46:02.408109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:02.408596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:02.408708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:02.430089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:02.430946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:02.510089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 600/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:02.535566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c999f-1ac3-4b41-bbcb-11671550c4d5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:02.654274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c999f-1ac3-4b41-bbcb-11671550c4d5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:02.705099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:02.705942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:02.706228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:02.706506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:02.717779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:02.719279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:02.738997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:02.740129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:02.741881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:02.741881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:02.741881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:02.741881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:02.741881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 603/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:02.746658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:02.866465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e60a32-5606-4278-b237-3dc84e171818 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:02.904122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:02.904958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:02.905179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:02.905448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:02.906264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:02.906636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:02.910596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdccf31-d856-4c58-8694-e5d3a58cc86a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:02.922926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 601/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:02.929177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:03.045207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718d90-d600-454e-8267-7499e16a6a25 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:03.088335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:03.089138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:03.089450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:03.089786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:03.090517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:03.093132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec3402-8edc-4a8c-8853-c1ad4b105009 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:03.115808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 604/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 5 14:46:02 2022] POST /identity/v3/users => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:46:05.639115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7120d-ade0-43b0-9716-ad75dec03451 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:05.639661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7120d-ade0-43b0-9716-ad75dec03451 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:05.639661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7120d-ade0-43b0-9716-ad75dec03451 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:05.641162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 602/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:05.646906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:05.647372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:05.647481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:05.666312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:05.667640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:05.752878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 605/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:05.788881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7120d-ade0-43b0-9716-ad75dec03451 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:05.902116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7120d-ade0-43b0-9716-ad75dec03451 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:05.944014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:05.944897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:05.945179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:05.945566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:05.958688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:05.967131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:05.968283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:05.969147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 603/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:46:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:05.974900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:06.083837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f82fd5-97d8-4685-91db-2362dfb0756e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:06.129531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:06.130609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:06.130947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:06.131321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:06.132037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:06.132437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:06.133762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:06.142719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 606/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:06.149145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:06.268059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709fea-70fb-4333-b699-a89280f03fb3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:06.307105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:06.307897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:06.308180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:06.308453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:06.324411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:06.326572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:06.346245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:06.347199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:06.348524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:06.348524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:06.348524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:06.348524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:06.348524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 604/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:06.353998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:06.480196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648297-2250-4fd7-b39c-5185e2494db0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:06.518328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:06.518996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:06.519281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:06.519558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:06.522161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:06.522499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:06.524495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:06.537877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 607/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:06.543840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:06.673311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d17-d623-4304-9317-07111d9d5111 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:06.712328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:06.713173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:06.713459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:06.713766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:06.723522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:06.727543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:06.747596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:06.748786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:06.750852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 605/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:06.754677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:06.882497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b40e-7e20-4783-a83d-5a619428d9e6 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:06.919855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:06.920531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:06.920813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:06.921089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:06.921951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:06.922264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:06.923732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:06.942827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 608/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:46:06.949002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:07.067088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcb5c-26dc-44e7-a3f9-20d7cafbb750 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:07.114974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:07.115656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:07.115930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:07.116268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:07.202753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:07.204591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:07.321721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:46:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:46:07.323531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:07.447147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17f198-c0fd-427a-8ed4-ebf3fce7def3 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:07.487496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:07.488213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:07.488548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:07.488781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:07.501275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:07.502915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:07.524942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:07.526887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:07.527810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:07.527810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:07.527810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:07.527810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:07.527810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 609/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:07.534058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:07.643908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29f01-f06b-4a68-aede-6a3d4b76938f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:07.679995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:07.680729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:07.680977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:07.681335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:07.682062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:07.682299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:07.683640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:07.700860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 607/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:07.703963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:07.820557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a1249-3e65-4cb8-9a3e-e6467e06bd53 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:07.859736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:07.860925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:07.861314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:07.861770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:07.870346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:07.873040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:07.890209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:07.891204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:07.892187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:07.897034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 610/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:07.900136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:08.010996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda51f6-9cb0-4dd1-9ccd-f88a9c3b263b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:08.050541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:08.051277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:08.051554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:08.051998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:08.052828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:08.053133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:08.055161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193210a1-5e2b-48ab-b415-5039b00c87f9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:08.077897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 608/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:08.082722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:08.196517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb35-c6d0-42d5-b84b-67393c100a60 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:08.234158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:08.234859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:08.235515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:08.235515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:08.236475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=738c11c19b03412d95720428d76d29b1) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:08.236793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:08.238487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68700d-d7c2-4162-a396-3237b37a8a16 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:08.244139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 611/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:46:08 2022] GET /identity/v3/role_assignments?user.id=738c11c19b03412d95720428d76d29b1&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:10.700418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9783-cb54-4b78-bfdb-7c6d6bc3e3a9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:10.700991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9783-cb54-4b78-bfdb-7c6d6bc3e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:10.700991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9783-cb54-4b78-bfdb-7c6d6bc3e3a9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:10.702643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 609/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:10.708358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:10.708818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:10.708901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:10.726036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:10.727209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:10.801933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 612/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:10.827441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9783-cb54-4b78-bfdb-7c6d6bc3e3a9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:10.931536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9783-cb54-4b78-bfdb-7c6d6bc3e3a9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:10.971416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:10.972134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:10.972416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:10.972690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:10.984085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:10.993216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:10.994393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:10.996040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 610/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:11.002754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.108800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f680-c493-4745-9f7f-1d374506fb17 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:11.143467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:11.144158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:11.144488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:11.144848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:11.145593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] RBAC: Adding query filter params (name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:11.145980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:11.147494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:11.156999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 613/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:11.163687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.272222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d45f0-56b4-4ca5-98f7-1e1f03c8b80c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:11.309316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:11.310234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:11.310510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:11.310798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:11.323065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:11.325320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:11.345952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:11.347248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:11.348319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:11.348319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:11.348319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:11.348319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:11.348319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 611/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:11.353825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.470912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598c2ca-62de-4f99-8b22-8eb16dd2f794 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:11.505568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:11.506306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:11.506659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:11.506946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:11.507672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:11.507975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:11.509384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:11.522323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 614/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:11.528506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.634634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941074-8143-47d7-a068-5de8ee7fe7cf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:11.671539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:11.672343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:11.672617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:11.672888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:11.680204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:11.681638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:11.696721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:11.697982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:11.699331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 612/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:11.703848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.808509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0cbb-be38-4674-8d74-5d503b2b162b None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:11.852486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:11.853156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:11.853438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:11.853744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:11.854585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:11.854921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:11.857164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:11.876396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 615/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:11.882347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:11.987468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85bee-f42f-4a8f-847b-b2cd62d4fb1c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:12.022047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:12.022904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:12.023233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:12.023556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:12.034563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:12.036188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:12.056888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:12.058062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:12.059517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:12.059517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:12.059517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:12.059517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:12.059517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 613/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:12.065513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:12.171574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43093-4634-4445-95bc-8cfd49861a82 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:12.209065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:12.209747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:12.210024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:12.210294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:12.211001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:12.211303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:12.212673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:12.224336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 616/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:12.229972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:12.341743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b148c-f5e9-4def-a799-9ed8da187ed1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:12.386497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:12.388645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:12.388931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:12.389212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:12.398031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:12.400061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:12.417845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:12.419476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:12.420595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 614/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:12.425607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:12.533127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7485-3125-4ed5-bea4-fb2c5dc74710 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:12.569588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:12.570318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:12.570688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:12.571122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:12.572146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:12.572512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:12.573997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b0af-d888-46d1-bfbb-6f0047ef9cfd None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:12.593638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 617/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:12.594722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:12.702888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932b0-bfd1-425b-b865-61e625cbb3e2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:12.736852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:12.737778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:12.738057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:12.738326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/738c11c19b03412d95720428d76d29b1/roles/4b53a4c7c8a24742bfecadad2f81a648` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:12.753715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=738c11c19b03412d95720428d76d29b1, role_id=4b53a4c7c8a24742bfecadad2f81a648)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:12.755167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8a69-7b53-48d2-849f-a7a2681ce9b1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:12.768608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 615/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:46:12 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/738c11c19b03412d95720428d76d29b1/roles/4b53a4c7c8a24742bfecadad2f81a648 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:46:15.212627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9c2f-90e5-4d9a-80e0-474adca70806 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:15.213219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9c2f-90e5-4d9a-80e0-474adca70806 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:15.213219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9c2f-90e5-4d9a-80e0-474adca70806 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:15.214548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 618/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:15.221572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:15.222079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:15.222079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:15.240279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:15.241616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:15.317738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 616/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:15.343273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9c2f-90e5-4d9a-80e0-474adca70806 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:15.452910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9c2f-90e5-4d9a-80e0-474adca70806 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:15.491319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:15.492086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:15.492392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:15.492691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] PATH_INFO: `/v3/roles/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:15.503932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:15.512369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:15.513607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:15.514705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 619/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 5 14:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:15.520179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:15.625180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55f819-98cb-4798-b8c7-3cd3c652d2be None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:15.663742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:15.664695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:15.664954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:15.665254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:15.666132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:15.666436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:15.667925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:15.679471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 617/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 5 14:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:15.684634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:15.790433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e19dc6-9809-4c83-9ba1-dafe161279be None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:15.831596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:15.832399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:15.832662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:15.833156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:15.846377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:15.848136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:15.872223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:15.873360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:15.874391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:15.874391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:15.874391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:15.874391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:15.875191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 620/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:15.880698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:15.979217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf96a-5b5f-4b85-9799-9b1d4f5e0702 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:16.015640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:16.016639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:16.016943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:16.017370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:16.018121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:16.018425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:16.019761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:16.037565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 618/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:16.039023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:16.144009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b1ff-5bd1-496b-8ab2-a0bfffd6ca0a None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:16.179330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:16.180450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:16.180947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:16.181250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:16.189524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:16.190973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:16.206260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:16.207334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:16.208300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 621/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:16.213450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:16.326509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e630f-1355-4159-a9f7-bd2481636a81 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:16.372063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:16.373111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:16.373499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:16.373795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:16.374709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:16.375187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:16.376719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:16.399146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 619/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:16.405089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:16.520628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dddb-1f94-49e7-8d16-f3ad6355b099 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:16.559627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:16.560351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:16.560703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:16.560990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:16.634504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:16.635938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:16.745664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 622/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:46:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:46:16.752887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:16.873326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcbc1-c0bb-47ab-ad1d-a2589932d3dc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:16.911247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:16.912117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:16.912397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:16.912672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:16.924228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:16.925699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:16.944900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:16.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:16.951893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:16.951893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:16.951893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:16.951893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:16.951893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 620/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:16.952254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:17.065565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b63643-4ef0-461a-8f49-4d152412421e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:17.102844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:17.103553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:17.103866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:17.104208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:17.104998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:17.105237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:17.107371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:17.119330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 623/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:17.125776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:17.236853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17e3f1-097e-404b-a616-d4dbd62057af None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:17.275098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:17.276020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:17.276327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:17.276600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:17.283762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:17.285212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:17.298808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:17.300162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:17.301265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 621/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:17.306131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:17.422367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587d40-571a-4d72-8605-b0e83f4c9ef0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:17.458548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:17.459280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:17.459581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:17.459892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:17.460713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:17.461022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:17.462694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f9ccb-adc2-4100-aaf5-03211b0888fd None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:17.477141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 624/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:17.483821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:17.586780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95baba-2cd8-46cc-8ad7-983b30542404 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:17.622753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:17.623402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:17.623679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:17.623948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:17.624777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] RBAC: Adding query filter params (role.id=4b53a4c7c8a24742bfecadad2f81a648, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=738c11c19b03412d95720428d76d29b1) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:17.625102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:17.626775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d685af9-966d-4784-afae-7ba70653e031 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:17.645678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 622/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:46:17 2022] GET /identity/v3/role_assignments?user.id=738c11c19b03412d95720428d76d29b1&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=4b53a4c7c8a24742bfecadad2f81a648 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:20.149534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f5aa0-45cf-4c33-be53-ac69845fa0a0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.150149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f5aa0-45cf-4c33-be53-ac69845fa0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.150149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f5aa0-45cf-4c33-be53-ac69845fa0a0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.151854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 625/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:46:20.158626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.159134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.159237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.176278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:20.177458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:20.248883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 623/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:46:20.273794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f5aa0-45cf-4c33-be53-ac69845fa0a0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:20.390790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f5aa0-45cf-4c33-be53-ac69845fa0a0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:20.431670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:20.432671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.432995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.433369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.446259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:20.454549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:20.455672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:20.456517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 626/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:20.462020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:20.566948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de952d-8996-464c-833a-ae2ec662e592 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:20.603673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:20.604475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.604810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.605137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.606458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:20.606825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:20.608311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:20.616958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 624/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:46:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:20.623138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:20.732943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549149c-8124-4b84-90fe-8ef821d6f2d0 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:20.771339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:20.772155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.772437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.772716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.783845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:20.785456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:20.805983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:20.807182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:20.808221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:20.808221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:20.808221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:20.808221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:20.808221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 627/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 14:46:20.814051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:20.927251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68a7b-8d1e-4efe-8533-ee0839f3e6c1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:20.962601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:20.963267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:20.963551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:20.963822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:20.964537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:20.964840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:20.966762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:20.978897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 625/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:20.985794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:21.090033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a962e-4218-4ddf-ba4d-2b3dcd372009 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:21.126458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:21.127262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:21.127545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:21.127819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:21.135896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:21.138037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:21.153559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:21.155185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:21.156126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 628/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:21.160890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:21.261130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f08e9-0f70-4b71-adb1-faa534ff8d5a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:21.295394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:21.296056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:21.296334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:21.296602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:21.297426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:21.297761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:21.299196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:21.317233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 626/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:21.323425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:21.444867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d43b8-ac2a-4685-864d-150e8cdd400f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:21.478364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:21.479019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:21.479301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:21.479577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:21.544058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:21.545411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:21.638897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 629/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:46:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:46:21.644649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:21.740011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652b7b-63aa-46f1-b43c-9562403dfff2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:21.772532 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:21.773305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:21.773584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:21.773882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:21.783328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:21.784781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:21.801463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:21.802523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:21.803626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:21.803626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:21.803626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:21.803626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:21.803626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 627/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:21.808223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:21.904318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44257-2313-4eb0-a95c-31a6c77d31b4 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:21.936946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:21.937588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:21.938156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:21.938434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:21.939142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:21.939447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:21.940803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:21.951552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 630/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:21.957127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:22.049940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3ca-e0a6-4013-9144-35677737fe55 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:22.081726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:22.082429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:22.082704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:22.082970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:22.089164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:22.090739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:22.103735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:22.104747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:22.106630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 628/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:22.111098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:22.204844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a509c9-dff9-42aa-b2f8-caaa56f7425f None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:22.237116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:22.237784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:22.238068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:22.238344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:22.239115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:22.239426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:22.240830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61df7c-72d5-412c-9187-39839d351c81 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:22.252199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 631/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:22.258017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:22.352542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58cf2a-f1aa-44c1-8712-e271454f1dab None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:22.383948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:22.384587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:22.384869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:22.385146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:22.385991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=738c11c19b03412d95720428d76d29b1) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:22.386303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:22.387834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda3368-23d4-4747-824b-7b92e51cb7a6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:22.392942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 629/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:46:22 2022] GET /identity/v3/role_assignments?user.id=738c11c19b03412d95720428d76d29b1&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:24.597483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6993-a4be-4819-a131-2a2aa36d35b3 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:24.598050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6993-a4be-4819-a131-2a2aa36d35b3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:24.598050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6993-a4be-4819-a131-2a2aa36d35b3 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:24.599421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 632/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:24.604671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:24.605097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:24.605315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:24.622529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:24.623831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:24.686740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 630/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:24.709837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6993-a4be-4819-a131-2a2aa36d35b3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:24.806101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6993-a4be-4819-a131-2a2aa36d35b3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:24.839267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:24.840101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:24.840381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:24.840655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:24.850213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:24.858274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:24.859347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:24.860223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 633/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:24.865292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:24.958084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a327e-36a5-499e-a96a-e0af202d3662 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:24.990585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:24.991228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:24.991504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:24.991773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:24.992495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:24.992792 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:24.994156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.002666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 631/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:25.008140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.103610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09f249-d368-463c-9882-a8e774148318 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.136377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.137589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.137894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.138166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.148103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.149513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:25.166175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:25.167229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:25.168968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:25.168968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:25.168968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:25.168968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:25.168968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 634/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:25.173815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.267945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17529e-4f54-4b42-8912-486b92803cbe None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.298531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.299174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.299454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.299731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.300437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:25.300742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.302117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.314003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 632/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:25.319565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.425175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0727558-27c1-4f97-b446-f4d0643bb427 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.458269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.459050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.459325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.459594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.466979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.468450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:25.482810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:25.483918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:25.485206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 635/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:25.489816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.588531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1753e4-6bd4-427a-9718-2f15b6f3c25d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.620093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.620741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.621681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.621969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.622780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:25.623084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.624487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.640780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 633/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:25.646315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.741546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70a40-9717-47b2-89d0-2dc3feaeca7c None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.772743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.773513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.773818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.774093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.783984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.785417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:25.802144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:25.803323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:25.804456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:25.804456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:25.804456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:25.804456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:25.804456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 636/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:25.809523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:25.902928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203af888-8ae8-45c7-bec0-9538663ac972 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:25.936053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:25.936703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:25.936981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:25.937258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:25.938264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:25.938567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:25.939910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:25.950926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 634/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:46:25.956494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:26.051765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524ce71-150c-472b-9db2-a1d92f2f0f16 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:26.083935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:26.084707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:26.084989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:26.085266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:26.092311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:26.093758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:26.108183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:26.109226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:26.110357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 637/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:26.114967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:26.208401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ac92b-2335-4a5a-9fc9-229d5b76c798 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:26.240333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:26.240970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:26.241249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:26.241520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:26.242323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:26.242627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:26.244051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a90-2ffa-49cb-a562-19d59adf2ab1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:26.255663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 635/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:26.261474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:26.363021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a09d1-b62a-4d4b-a05c-1ec728ed3a6e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:26.396504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:26.397371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:26.397689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:26.397950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] PATH_INFO: `/v3/projects/8de15899c587405f8801dbb34b698b6d/users/738c11c19b03412d95720428d76d29b1/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:26.399873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de15899c587405f8801dbb34b698b6d, user_id=738c11c19b03412d95720428d76d29b1, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:26.401275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d85d76-621e-4ec5-8634-a4f4ba99abe8 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:26.414003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 638/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 5 14:46:26 2022] PUT /identity/v3/projects/8de15899c587405f8801dbb34b698b6d/users/738c11c19b03412d95720428d76d29b1/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:46:28.619605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f04a5-12f8-402d-a564-69af7450e993 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:28.620126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f04a5-12f8-402d-a564-69af7450e993 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:28.620126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f04a5-12f8-402d-a564-69af7450e993 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:28.622573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 636/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:28.627820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389a55-0d10-4fe1-8472-77730713234f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:28.628242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389a55-0d10-4fe1-8472-77730713234f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:28.628371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389a55-0d10-4fe1-8472-77730713234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:28.644406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-83389a55-0d10-4fe1-8472-77730713234f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:28.645559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-83389a55-0d10-4fe1-8472-77730713234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:28.708889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 639/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:28.733066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f04a5-12f8-402d-a564-69af7450e993 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:28.830104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f04a5-12f8-402d-a564-69af7450e993 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:28.862001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:28.862770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:28.863044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:28.863309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:28.873297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 14:46:28.880712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:28.881825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:28.882717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 637/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 5 14:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:28.887987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389a55-0d10-4fe1-8472-77730713234f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:28.983454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389a55-0d10-4fe1-8472-77730713234f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.015814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.016456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.016736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.017004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.017762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:29.018066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.019413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.026958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 640/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 5 14:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:29.032760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:29.127240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef0edc-d35c-40c7-a25b-a3ecfcbb2a81 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.158566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.159328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.159610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.159880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.169907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.171329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:29.188357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:29.189405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:29.190376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:29.190376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:29.190376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:29.190376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:29.190376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 638/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:29.195144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:29.287447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d627c-ac87-422b-af2b-dcf2e1a37f34 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.319341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.320033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.320240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.320559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.321266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:29.321516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.323119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.343309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 641/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:46:29.344721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:29.446696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb1a51-3985-4a28-9871-ee82cabc7e26 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.478281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.479074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.479354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.479626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.487414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.488858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 14:46:29.503237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:29.504354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:29.505814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 639/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:29.510271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:29.604080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268decc-849b-4944-b0a4-875843686c17 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.636665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.637617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.637924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.638194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.639012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:29.639318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.640718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.657155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 642/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:29.662769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:29.757475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cdbaa-37c1-4af6-ac4e-e2d4a5e84e32 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:29.789263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:29.789909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:29.790186 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:29.790456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:29.854323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:29.856657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:29.958555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 640/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 14:46:29.964329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:30.057920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69ec1-378b-4860-a549-62ddb1b5b3d5 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:30.090849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:30.091623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:30.091904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:30.092176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:30.101555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:30.103003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 14:46:30.119860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:30.120994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:30.126648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 14:46:30.126648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 14:46:30.126648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 14:46:30.126648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:30.126648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 643/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:30.126991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:30.221395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36467fa-f0f5-43a9-a26d-34190f4b8f1e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:30.252672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:30.253317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:30.253595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:30.253898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:30.254608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:30.254922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:30.256280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:30.267500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 641/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 5 14:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:46:30.272965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:30.373457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4772d-b772-47b8-862d-cf9f38c12d84 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:30.405756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:30.406529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:30.406808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:30.407077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:30.413405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:30.414858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 14:46:30.428191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application with Lock( May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:30.429248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: ERROR keystone.server.flask.application May 05 14:46:30.430215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 644/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 5 14:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:30.435258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:30.530138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcc701-2881-4e7e-aaaa-448677a14ced None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:30.561199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:30.561868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:30.562149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:30.562419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:30.563442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:30.563742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:30.565142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e613a-f16c-432b-a166-fed4ca06e269 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:30.577216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 642/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 5 14:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:30.583225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:30.679174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928eff-4914-4824-ba61-6966cb039c12 None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:30.711571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:30.712205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:30.712492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:30.712770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:30.713587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] RBAC: Adding query filter params (role.id=bff88c5c7fe34509acfa67ec769df632, scope.project.id=8de15899c587405f8801dbb34b698b6d, user.id=738c11c19b03412d95720428d76d29b1) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:30.713938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:30.715343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f716d22-49b4-4de0-9b88-2ffd00890c90 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:30.720869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 645/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 5 14:46:30 2022] GET /identity/v3/role_assignments?user.id=738c11c19b03412d95720428d76d29b1&scope.project.id=8de15899c587405f8801dbb34b698b6d&role.id=bff88c5c7fe34509acfa67ec769df632 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:32.958259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c99d-4461-4013-b437-f1b14f502e23 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:32.958799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c99d-4461-4013-b437-f1b14f502e23 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:32.958799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c99d-4461-4013-b437-f1b14f502e23 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:32.960155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 643/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:32.965199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:32.965631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:32.965769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:32.981927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:32.983080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:33.045322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 646/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:33.068154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4c99d-4461-4013-b437-f1b14f502e23 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:33.164105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4c99d-4461-4013-b437-f1b14f502e23 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:33.197042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:33.197848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:33.198132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:33.198407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:33.199094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:33.200444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:33.211872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:33.213060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:33.213977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 644/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:46:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:33.219079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:33.311931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969076d2-a4c2-4313-b355-5b9f9a5996bf None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:33.346856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:33.347714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:33.347897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:33.348124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:33.348810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:33.349122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:33.350639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b2200-8543-4368-b60b-13773aae5750 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:33.356501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 647/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 5 14:46:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:33.362570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:33.464174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dddf27-fe4e-4c44-adc6-9807a2dbf46a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:33.496753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:33.497400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:33.497705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:33.497986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:33.498685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:33.498993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:33.500345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed311ab-5c09-4fb6-88ad-377f6ca947c4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:33.504546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 645/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 5 14:46:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:35.729623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa07f7-dad6-454a-8633-6ee8f5a11192 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:35.730394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa07f7-dad6-454a-8633-6ee8f5a11192 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:35.730394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa07f7-dad6-454a-8633-6ee8f5a11192 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:35.731642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 648/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:35.736788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6269ee-3032-41e2-8897-c98c63803cca None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:35.737194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6269ee-3032-41e2-8897-c98c63803cca None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:35.737333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6269ee-3032-41e2-8897-c98c63803cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:35.754272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4c6269ee-3032-41e2-8897-c98c63803cca None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:35.755429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4c6269ee-3032-41e2-8897-c98c63803cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:35.818158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 646/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:35.841063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa07f7-dad6-454a-8633-6ee8f5a11192 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:35.935968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa07f7-dad6-454a-8633-6ee8f5a11192 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:35.968156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:35.968806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:35.969086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:35.969359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:35.970096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:35.971439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713674a-9ab4-462c-8c8a-4f1e1110f2c1 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:35.984161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 649/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 5 14:46:35 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:46:38.223573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71e3ee-2b86-490c-846a-882a9d0ea54e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.224101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71e3ee-2b86-490c-846a-882a9d0ea54e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.224101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71e3ee-2b86-490c-846a-882a9d0ea54e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.225487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 647/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:38.230633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.231042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.231187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.247859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:38.249027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:38.317782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 650/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 14:46:38.345967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71e3ee-2b86-490c-846a-882a9d0ea54e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:38.441746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71e3ee-2b86-490c-846a-882a9d0ea54e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:38.474572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:38.475292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.475569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.475837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.476476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:38.477858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:38.489571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:38.490767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:38.491780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 648/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:46:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:38.496757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:38.591563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a57f-82ca-477e-ae69-7e8c4eb29a2c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:38.623027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:38.623669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.623949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.624223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.624916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] RBAC: Adding query filter params (name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:38.625219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:38.626583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:38.631428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 651/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 5 14:46:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:38.637691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:38.731464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d754e-904d-4853-a140-606232b4f426 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:38.763121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:38.763764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.764046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.764319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.765090 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] RBAC: Adding query filter params (interface=public, service_id=3930dd9c93d64450afa88d29d998e1ca, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:38.765399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:38.766771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd2cf5-f97f-481c-8524-e02bbe3c5477 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:38.771595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 649/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 5 14:46:38 2022] GET /identity/v3/endpoints?service_id=3930dd9c93d64450afa88d29d998e1ca&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:46:38.777269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:38.873461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4111d-954a-4f2f-9a9f-4767401a8e2e None admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:38.905229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:38.905906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:38.906183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:38.906451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:38.907112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:38.908433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e61c3-b619-49a9-809d-604d357c1166 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:38.914835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 652/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 5 14:46:38 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:46:41.224649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbd58-1248-458a-9661-389582ae5f73 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:41.225176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbd58-1248-458a-9661-389582ae5f73 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:41.225176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbd58-1248-458a-9661-389582ae5f73 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:41.226559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 650/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:46:41.232335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:41.232749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:41.232887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:41.248963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:46:41.250162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:46:41.313371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 653/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:46:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 14:46:41.336032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fbd58-1248-458a-9661-389582ae5f73 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:41.429983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fbd58-1248-458a-9661-389582ae5f73 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:41.462076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:41.462848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:41.463127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:41.463398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] PATH_INFO: `/v3/services/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:41.464087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:41.466083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:46:41.477477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:46:41.478868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 05 14:46:41.479935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 651/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 5 14:46:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 14:46:41.484619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:41.576811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359b57d-92cd-4acd-9d14-e957ef649141 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:41.609266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:41.609948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:41.610229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:41.610526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] PATH_INFO: `/v3/services` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:41.611222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:46:41.611527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:41.612880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015757c9-fc20-4f31-a29b-d66f83d75c19 None admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:41.617838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 654/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 5 14:46:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:46:41.624223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:46:41.721156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774f48-42c5-4a00-b11f-d740ae38a27f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:46:41.756413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:46:41.756984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:46:41.757261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:46:41.757530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:46:41.758281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:46:41.759614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea631a63-65e4-4224-9114-fc6bed74ad0d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:46:41.778915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 652/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 5 14:46:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:47:45.660468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215353-9e79-4cbe-9387-7cce05dc5b48 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:45.661391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215353-9e79-4cbe-9387-7cce05dc5b48 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:45.661915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215353-9e79-4cbe-9387-7cce05dc5b48 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:45.665998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 655/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:47:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:45.669215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61e13-90e6-4e6c-89fa-01d73555dd86 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:45.670017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61e13-90e6-4e6c-89fa-01d73555dd86 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:45.670950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61e13-90e6-4e6c-89fa-01d73555dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:45.754789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a5e61e13-90e6-4e6c-89fa-01d73555dd86 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:45.756208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a5e61e13-90e6-4e6c-89fa-01d73555dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:45.880449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 653/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:45.929799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:45.930008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:45.932267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:45.935917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 656/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 5 14:47:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:45.943770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55ba0-d31a-497d-9c6f-d575888ed0df None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:45.944064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55ba0-d31a-497d-9c6f-d575888ed0df None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:45.944351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55ba0-d31a-497d-9c6f-d575888ed0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:46.051674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6ae55ba0-d31a-497d-9c6f-d575888ed0df None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:46.053204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6ae55ba0-d31a-497d-9c6f-d575888ed0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:46.131910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 654/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 5 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:46.141540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:47:46.143289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:46.264446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fb50-d2cd-40e7-80ef-9f37d1dbd858 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:47:46.343627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:47:46.344364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:46.344715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:46.345054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:46.346771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:46.470469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:47:46.471826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0f7f8-710a-404b-9ebf-5d4f8c7bd2db service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:47:46.490208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 657/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:47:49.093357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:49.094373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:49.094817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:49.102780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4133-0978-449c-aa0f-cdf4b94f8907 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:49.103761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4133-0978-449c-aa0f-cdf4b94f8907 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:49.104205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4133-0978-449c-aa0f-cdf4b94f8907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:49.106112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 655/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:47:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:49.189792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b4ac4133-0978-449c-aa0f-cdf4b94f8907 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:49.191038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b4ac4133-0978-449c-aa0f-cdf4b94f8907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:49.300349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 658/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:49.341213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:47:49.343431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:49.454128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee0e2-0f46-4272-966e-da9974f1bdc1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:47:49.532276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:47:49.532923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:49.533196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:49.533462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:49.535104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:49.646133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:47:49.648058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e30ca-4de7-4b39-9cd0-55ca3c846b1e service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:47:49.670016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 656/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:47:52.313969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:52.314539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:52.314639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:52.316032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 659/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:52.321412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b69f-c5cb-4081-9046-13dd104f67df None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:52.321852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b69f-c5cb-4081-9046-13dd104f67df None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:52.322033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b69f-c5cb-4081-9046-13dd104f67df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:52.383730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d986b69f-c5cb-4081-9046-13dd104f67df None None] MFA Rules not processed for user `37a535f74d794b958f30b4b934376917`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:52.384912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d986b69f-c5cb-4081-9046-13dd104f67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:52.477223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 657/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:52.525500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:47:52.527046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:52.628853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45bac1-15e4-4605-9b7e-9d7118fdb713 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:47:52.698795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:47:52.699429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:52.699710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:52.699983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:52.701592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:52.807654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:47:52.809063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd565d-f0c6-4069-a807-818474b88347 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:47:52.827276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 660/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:47:55.584804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:55.585254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:55.585349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:55.586878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 658/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:55.592120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a12e9-fa57-417a-9b9d-465ee97c13a6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:55.592526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a12e9-fa57-417a-9b9d-465ee97c13a6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:55.592671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a12e9-fa57-417a-9b9d-465ee97c13a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:55.654978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-638a12e9-fa57-417a-9b9d-465ee97c13a6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:55.656168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-638a12e9-fa57-417a-9b9d-465ee97c13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:55.749984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 661/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:55.788032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:47:55.790294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:55.888387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e405ce-fb28-458c-b081-e92be453c789 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:47:55.959548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:47:55.960188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:55.960469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:55.961315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:55.962992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:56.067141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:47:56.068520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff309f93-fe92-48e4-b5a8-49e43f216d37 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:47:56.086862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 659/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:47:58.992866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:58.993479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:58.993479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:58.994801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 662/1321] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:47:59.000020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022ae-4037-4fce-8096-7dfb44471502 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:59.000417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022ae-4037-4fce-8096-7dfb44471502 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:59.000698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219022ae-4037-4fce-8096-7dfb44471502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:59.062539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-219022ae-4037-4fce-8096-7dfb44471502 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:47:59.063736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-219022ae-4037-4fce-8096-7dfb44471502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:59.155270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 660/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:47:59.191995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:47:59.193506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:59.294943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483490-70f4-4395-9227-77343dc2c9d5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:47:59.369449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:47:59.370146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:47:59.370432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:47:59.370712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:47:59.372349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:47:59.480797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:47:59.482697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71956-b1ec-4766-a439-f6909336f716 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:47:59.502340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 663/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:01.849757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2e065-b66d-4b56-b996-d2ecdab28a81 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:01.850260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2e065-b66d-4b56-b996-d2ecdab28a81 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:01.850260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2e065-b66d-4b56-b996-d2ecdab28a81 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:01.851707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 661/1324] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:48:01.856948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034b6f-f1db-4a2d-b603-2b8d49dd7ede None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:01.857355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034b6f-f1db-4a2d-b603-2b8d49dd7ede None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:01.857543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034b6f-f1db-4a2d-b603-2b8d49dd7ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:01.919631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-08034b6f-f1db-4a2d-b603-2b8d49dd7ede None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:01.920801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-08034b6f-f1db-4a2d-b603-2b8d49dd7ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:02.014276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 664/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:02.066860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:02.067149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:02.067423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:02.068930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 662/1326] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 5 14:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:02.075657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b5ba-92ab-413b-aecb-8f6a37477ef9 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:02.075944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b5ba-92ab-413b-aecb-8f6a37477ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:02.076219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b5ba-92ab-413b-aecb-8f6a37477ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:02.147397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d082b5ba-92ab-413b-aecb-8f6a37477ef9 None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:02.148518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d082b5ba-92ab-413b-aecb-8f6a37477ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:02.220958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 665/1327] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 5 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:02.229932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:02.231435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:02.331218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b53db-3bbd-4475-9dd5-ed7a3b463b0a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:02.403658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:02.404218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:02.404496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:02.404768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:02.406486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:02.513178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:02.514640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36117d-eb49-49d6-aa22-b8f063da20be service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:02.532215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 663/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:05.065898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:05.066470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:05.066470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:05.067810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 666/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:05.073718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9f41-abd6-4ab0-b3de-b24198781b17 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:05.074151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9f41-abd6-4ab0-b3de-b24198781b17 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:05.074438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9f41-abd6-4ab0-b3de-b24198781b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:05.138861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-49ce9f41-abd6-4ab0-b3de-b24198781b17 None None] MFA Rules not processed for user `37a535f74d794b958f30b4b934376917`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:05.140060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-49ce9f41-abd6-4ab0-b3de-b24198781b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:05.231303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 664/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:05.269792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:05.271299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:05.369628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40ec34-fa5c-4055-a9e6-0aa5fe229270 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:05.441153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:05.441839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:05.442121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:05.442395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:05.444050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:05.552351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:05.553810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d478e-2689-4709-aba5-1620c3f3e996 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:05.573141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 667/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:08.267178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:08.267672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:08.267786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:08.269089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 665/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:08.274546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fd20d-4efe-407a-a835-cdd4364fc640 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:08.275004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fd20d-4efe-407a-a835-cdd4364fc640 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:08.275097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fd20d-4efe-407a-a835-cdd4364fc640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:08.341808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7d5fd20d-4efe-407a-a835-cdd4364fc640 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:08.343124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7d5fd20d-4efe-407a-a835-cdd4364fc640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:08.441493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 668/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:08.478264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:08.479769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:08.579919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b279-aec5-4fa7-8c35-bc018aaadf97 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:08.651296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:08.651938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:08.652216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:08.652486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:08.654119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:08.760679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:08.762321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2a47b-331c-40e9-bd4c-c2fe5fb34900 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:08.780754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 666/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:11.075754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:11.076292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:11.076292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:11.077692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 669/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:11.082777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6a62-619a-4e23-b24b-7bf0dcf4eed4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:11.083200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6a62-619a-4e23-b24b-7bf0dcf4eed4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:11.083331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6a62-619a-4e23-b24b-7bf0dcf4eed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:11.145035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2f2e6a62-619a-4e23-b24b-7bf0dcf4eed4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:11.146263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2f2e6a62-619a-4e23-b24b-7bf0dcf4eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:11.238694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 667/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:11.278856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:11.280362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:11.378739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66583d0e-a75b-4867-8adc-3d57bef06ffc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:11.449121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:11.449801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:11.450083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:11.450357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:11.451969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:11.557753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:11.559168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbed7c-d073-445a-a3aa-67fb578a3ab3 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:11.577513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 670/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:14.178765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:14.179546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:14.179825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:14.181175 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 668/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:14.186351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87ae0-c724-4c66-95b6-dd916bc9f1f4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:14.186775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87ae0-c724-4c66-95b6-dd916bc9f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:14.186901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87ae0-c724-4c66-95b6-dd916bc9f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:14.249490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5ba87ae0-c724-4c66-95b6-dd916bc9f1f4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:14.250700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5ba87ae0-c724-4c66-95b6-dd916bc9f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:14.344968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 671/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:14.379454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:14.380943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:14.482152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21c0d6-0f18-43d2-870a-ce5e4a72b13a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:14.551889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:14.552524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:14.552802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:14.553066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:14.555250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:14.668810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:14.670537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f9f1-c8bb-418f-8d7b-3b5e787e646a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:14.688783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 669/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:18.921623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:18.922227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:18.922227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:18.923502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 672/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:18.928981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0d41-7747-42bd-b5bd-a914c35c80c1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:18.929431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0d41-7747-42bd-b5bd-a914c35c80c1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:18.929703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0d41-7747-42bd-b5bd-a914c35c80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:19.000719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4f6b0d41-7747-42bd-b5bd-a914c35c80c1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:19.001999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4f6b0d41-7747-42bd-b5bd-a914c35c80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:19.103794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 670/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:19.142745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:19.145112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:19.238428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a282-deb4-4216-bd02-aa262a859e0d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:19.243003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:19.243641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:19.243948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:19.244221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:19.253230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:19.254677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c0817-5616-40e5-ab60-37b15bd8d5b5 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:19.264803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 673/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:48:22.158942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b4a8-1bca-4e9b-92f9-3de161a78b15 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:22.159452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b4a8-1bca-4e9b-92f9-3de161a78b15 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:22.159452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b4a8-1bca-4e9b-92f9-3de161a78b15 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:22.160763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 671/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:22.166616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed9df-e845-46a0-bf52-05276e4e4b73 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:22.167061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed9df-e845-46a0-bf52-05276e4e4b73 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:22.167190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed9df-e845-46a0-bf52-05276e4e4b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:22.194973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a07ed9df-e845-46a0-bf52-05276e4e4b73 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:22.196164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a07ed9df-e845-46a0-bf52-05276e4e4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:22.269165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 674/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:22.307027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b4a8-1bca-4e9b-92f9-3de161a78b15 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:22.317671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b4a8-1bca-4e9b-92f9-3de161a78b15 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:22.321303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:22.321939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:22.322209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:22.322485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:22.331319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:22.332858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743dbc-774b-437e-b979-75f40348f215 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:22.345565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 672/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:48:26.565984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3434a-5b39-49b1-ad51-7f24fba58364 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:26.566526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3434a-5b39-49b1-ad51-7f24fba58364 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:26.566526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3434a-5b39-49b1-ad51-7f24fba58364 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:26.567901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 675/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:26.573733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8d57-8233-4c97-b90b-bd51a2d79ec6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:26.574158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8d57-8233-4c97-b90b-bd51a2d79ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:26.574274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8d57-8233-4c97-b90b-bd51a2d79ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:26.593575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-92aa8d57-8233-4c97-b90b-bd51a2d79ec6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:26.594816 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-92aa8d57-8233-4c97-b90b-bd51a2d79ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:26.602900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 673/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:26.640892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3434a-5b39-49b1-ad51-7f24fba58364 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:26.652321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3434a-5b39-49b1-ad51-7f24fba58364 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:26.656112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:26.656826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:26.657175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:26.657516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:26.667130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:26.668630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3607436-3b66-4a2b-b0b8-588d568702f2 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:26.678262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 676/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:32.175738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9aa5-d191-4374-a554-35b8e41f6290 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:32.176298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9aa5-d191-4374-a554-35b8e41f6290 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:32.176298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9aa5-d191-4374-a554-35b8e41f6290 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:32.178495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 674/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:32.183446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4386b28-d9ef-4da3-934c-678df4d6d109 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:32.183883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4386b28-d9ef-4da3-934c-678df4d6d109 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:32.183975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4386b28-d9ef-4da3-934c-678df4d6d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:32.266848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f4386b28-d9ef-4da3-934c-678df4d6d109 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:32.268021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f4386b28-d9ef-4da3-934c-678df4d6d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:32.390986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 677/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:36.698405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cd3-9a16-42f5-a0b8-15c87d298785 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:36.699306 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cd3-9a16-42f5-a0b8-15c87d298785 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:36.699575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cd3-9a16-42f5-a0b8-15c87d298785 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:36.701277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 675/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:48:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:36.706817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea8ad-d07b-4caf-af8a-cabbd162ddc7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:36.707256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea8ad-d07b-4caf-af8a-cabbd162ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:36.707506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea8ad-d07b-4caf-af8a-cabbd162ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:36.726725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-fd8ea8ad-d07b-4caf-af8a-cabbd162ddc7 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:36.728058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fd8ea8ad-d07b-4caf-af8a-cabbd162ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:36.736939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 678/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:38.115117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113f42-cf37-46d9-bd19-50a4b5756284 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:38.115721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113f42-cf37-46d9-bd19-50a4b5756284 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:38.115845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113f42-cf37-46d9-bd19-50a4b5756284 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:38.117298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 676/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:38.122477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1726db-259b-472b-bddd-29803acde955 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:38.122924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1726db-259b-472b-bddd-29803acde955 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:38.123082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1726db-259b-472b-bddd-29803acde955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:38.140834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4a1726db-259b-472b-bddd-29803acde955 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:38.142034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4a1726db-259b-472b-bddd-29803acde955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:38.150918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 679/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:48:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:42.180100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ce12-0347-4927-8164-f0070adf0b27 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:42.180613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ce12-0347-4927-8164-f0070adf0b27 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:42.180718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ce12-0347-4927-8164-f0070adf0b27 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:42.182345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 677/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:42.187196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6231-24ac-4c21-a6e8-45c5322a9a74 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:42.187860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6231-24ac-4c21-a6e8-45c5322a9a74 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:42.188007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6231-24ac-4c21-a6e8-45c5322a9a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:42.206675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8f2e6231-24ac-4c21-a6e8-45c5322a9a74 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:42.207832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8f2e6231-24ac-4c21-a6e8-45c5322a9a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:42.216489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 680/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:42.263708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ffb1-f771-4757-adcc-e944bd00fbba None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:42.263995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ffb1-f771-4757-adcc-e944bd00fbba None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:42.264272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609ffb1-f771-4757-adcc-e944bd00fbba None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:42.265683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 678/1358] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:42.270680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2690c-ad8d-4214-b2d0-9099b45ae705 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:42.270963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2690c-ad8d-4214-b2d0-9099b45ae705 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:42.271416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2690c-ad8d-4214-b2d0-9099b45ae705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:42.326879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-dcf2690c-ad8d-4214-b2d0-9099b45ae705 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:42.328375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dcf2690c-ad8d-4214-b2d0-9099b45ae705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:42.411930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 681/1359] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:42.421627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609ffb1-f771-4757-adcc-e944bd00fbba None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:42.438293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609ffb1-f771-4757-adcc-e944bd00fbba None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:42.444236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:42.445131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:42.445624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:42.446107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:42.457205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:42.459132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9245b81-7e88-4fe6-8929-8ac1bdc0b0f2 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:42.473916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 679/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:44.992688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed982f-71c2-4274-807f-967d9c1489fc None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:44.993167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed982f-71c2-4274-807f-967d9c1489fc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:44.993268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed982f-71c2-4274-807f-967d9c1489fc None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:44.994658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 682/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:45.000011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb163-2554-49f2-8d22-b0d3af69f7c6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:45.000445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb163-2554-49f2-8d22-b0d3af69f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:45.000570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb163-2554-49f2-8d22-b0d3af69f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:45.018294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-beeeb163-2554-49f2-8d22-b0d3af69f7c6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:45.019739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-beeeb163-2554-49f2-8d22-b0d3af69f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:45.028337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 680/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:45.073460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed982f-71c2-4274-807f-967d9c1489fc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:45.087841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed982f-71c2-4274-807f-967d9c1489fc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:45.093157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:45.093835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:45.094117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:45.094504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:45.103589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:45.105203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51813c8c-7095-4ccc-bf62-45705c7c840b service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:45.114643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 683/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:47.711549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8369fc-ad87-4031-bd49-e43b6cec4e62 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:47.712058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8369fc-ad87-4031-bd49-e43b6cec4e62 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:47.712058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8369fc-ad87-4031-bd49-e43b6cec4e62 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:47.713473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 681/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:47.718968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f185f7-31a4-42cc-92d4-5da6632925d6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:47.719387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f185f7-31a4-42cc-92d4-5da6632925d6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:47.719545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f185f7-31a4-42cc-92d4-5da6632925d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:47.738310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-46f185f7-31a4-42cc-92d4-5da6632925d6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:47.739489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-46f185f7-31a4-42cc-92d4-5da6632925d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:47.747234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 684/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:47.792270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c91b9-98a0-42ad-a265-7b76fc69b159 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:47.792552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c91b9-98a0-42ad-a265-7b76fc69b159 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:47.792825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c91b9-98a0-42ad-a265-7b76fc69b159 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:47.794190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 682/1366] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:47.799480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3556-0004-421b-9868-cf29cf7e26ef None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:47.799772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3556-0004-421b-9868-cf29cf7e26ef None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:47.800051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3556-0004-421b-9868-cf29cf7e26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:47.819590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-391e3556-0004-421b-9868-cf29cf7e26ef None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:47.820827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-391e3556-0004-421b-9868-cf29cf7e26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:47.829974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 685/1367] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:47.842356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c91b9-98a0-42ad-a265-7b76fc69b159 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:47.856681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c91b9-98a0-42ad-a265-7b76fc69b159 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:47.862134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:47.862838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:47.863207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:47.863546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:47.872146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:47.873729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378cd7c-2dfb-4700-91df-7935951fc40a service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:47.884135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 683/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:50.238944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b024bee-ee9c-4c9e-a946-a77c254e1735 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.239538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b024bee-ee9c-4c9e-a946-a77c254e1735 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.239538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b024bee-ee9c-4c9e-a946-a77c254e1735 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.242117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 686/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:50.247021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f818788-fd65-40cc-b9de-76c944a340d6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.247483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f818788-fd65-40cc-b9de-76c944a340d6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.247578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f818788-fd65-40cc-b9de-76c944a340d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.265981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2f818788-fd65-40cc-b9de-76c944a340d6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:50.267174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2f818788-fd65-40cc-b9de-76c944a340d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:50.276026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 684/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:50.320988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b024bee-ee9c-4c9e-a946-a77c254e1735 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:50.335796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b024bee-ee9c-4c9e-a946-a77c254e1735 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:50.342070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:50.342884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.343339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.343731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.354840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:50.356762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3cd2b-e04b-433f-9385-f763ad9ce105 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:50.369840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 687/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:50.384279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8a0b-e7ca-40b5-907e-4d246ed53b5c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.384612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8a0b-e7ca-40b5-907e-4d246ed53b5c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.384895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8a0b-e7ca-40b5-907e-4d246ed53b5c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.386537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 685/1372] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:50.392604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244d05-f796-42c6-8e31-85f0f0d1fe31 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.393045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244d05-f796-42c6-8e31-85f0f0d1fe31 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.393429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244d05-f796-42c6-8e31-85f0f0d1fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.417809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c9244d05-f796-42c6-8e31-85f0f0d1fe31 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:50.419123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c9244d05-f796-42c6-8e31-85f0f0d1fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:50.433794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 688/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:50.752109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9351-230e-4306-9081-7ab1d9f3fbfb None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.752513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9351-230e-4306-9081-7ab1d9f3fbfb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.752936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9351-230e-4306-9081-7ab1d9f3fbfb None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.754803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 686/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 5 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:50.760688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582e2d0-fdb5-4ad4-929d-833233d03acb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.760990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582e2d0-fdb5-4ad4-929d-833233d03acb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.761542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582e2d0-fdb5-4ad4-929d-833233d03acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.818343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b582e2d0-fdb5-4ad4-929d-833233d03acb None None] MFA Rules not processed for user `7d1bd23334ec406f81303f12c5672889`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:50.819627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b582e2d0-fdb5-4ad4-929d-833233d03acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:50.878845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 689/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 5 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:50.886519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9351-230e-4306-9081-7ab1d9f3fbfb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:50.897329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9351-230e-4306-9081-7ab1d9f3fbfb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:50.901000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:50.901638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:50.901958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:50.902232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:50.911149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:50.913675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd498ba-b65a-4502-90c9-018ececbdc43 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:50.924472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 687/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:52.673514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784c64-1623-41fa-9ec6-67c53216088e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:52.674059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784c64-1623-41fa-9ec6-67c53216088e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:52.674163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784c64-1623-41fa-9ec6-67c53216088e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:52.675510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 690/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:52.681065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bdc1-25f3-4deb-955e-623e3f416d81 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:52.681492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bdc1-25f3-4deb-955e-623e3f416d81 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:52.681636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545bdc1-25f3-4deb-955e-623e3f416d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:52.700842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0545bdc1-25f3-4deb-955e-623e3f416d81 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:52.702215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0545bdc1-25f3-4deb-955e-623e3f416d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:52.710713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 688/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:52.754578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784c64-1623-41fa-9ec6-67c53216088e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:52.769969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784c64-1623-41fa-9ec6-67c53216088e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:52.776258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:52.776910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:52.777191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:52.777473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:52.786023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:52.787614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982fbd-ae9b-4352-b5c7-07a2820f0150 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:52.799762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 691/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:55.098731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43541-934c-429b-904f-843d5e8ef66c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:55.099297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43541-934c-429b-904f-843d5e8ef66c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:55.099297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43541-934c-429b-904f-843d5e8ef66c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:55.101185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 689/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:48:55.106517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf44d-195b-4c61-9b41-800d205a0b16 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:55.106934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf44d-195b-4c61-9b41-800d205a0b16 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:55.107072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf44d-195b-4c61-9b41-800d205a0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:55.125098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-863bf44d-195b-4c61-9b41-800d205a0b16 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:55.126297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-863bf44d-195b-4c61-9b41-800d205a0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:55.134517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 692/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:48:55.178804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a43541-934c-429b-904f-843d5e8ef66c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:55.192925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a43541-934c-429b-904f-843d5e8ef66c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:55.198818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:55.199453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:55.199725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:55.200168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:55.208118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:55.210428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98673593-c90c-4d64-a647-ed7b60c91b6e service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:55.219812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 690/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:57.523769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bcc0-0ac1-43e3-be6e-ee945bd155af None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:57.524345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bcc0-0ac1-43e3-be6e-ee945bd155af None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:57.524345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bcc0-0ac1-43e3-be6e-ee945bd155af None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:57.525751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 693/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:57.531172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314ef-d8a6-4243-b0da-185e9d80be1b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:57.531567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314ef-d8a6-4243-b0da-185e9d80be1b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:57.531731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314ef-d8a6-4243-b0da-185e9d80be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:57.549638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-715314ef-d8a6-4243-b0da-185e9d80be1b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:57.550848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-715314ef-d8a6-4243-b0da-185e9d80be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:57.558983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 691/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:48:57.603877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136bcc0-0ac1-43e3-be6e-ee945bd155af None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:48:57.618303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136bcc0-0ac1-43e3-be6e-ee945bd155af None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:48:57.623784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:48:57.624610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:57.624964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:57.625315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:57.633935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:48:57.635602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe85ef4-f03f-45f5-a6bd-744d79c0ed2f service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:48:57.645583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 694/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:48:59.925134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe43e-b0e9-41bd-bead-0d1e1cb80199 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:59.925809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe43e-b0e9-41bd-bead-0d1e1cb80199 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:59.925809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe43e-b0e9-41bd-bead-0d1e1cb80199 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:59.926989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 692/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:48:59.933235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707f67-f9f9-4a59-8a1e-a7cdfdbc156c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:48:59.933892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707f67-f9f9-4a59-8a1e-a7cdfdbc156c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:48:59.933892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707f67-f9f9-4a59-8a1e-a7cdfdbc156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:48:59.954055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8d707f67-f9f9-4a59-8a1e-a7cdfdbc156c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:48:59.955311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8d707f67-f9f9-4a59-8a1e-a7cdfdbc156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:48:59.963428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 695/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:00.019237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fe43e-b0e9-41bd-bead-0d1e1cb80199 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:00.033903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fe43e-b0e9-41bd-bead-0d1e1cb80199 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:00.039426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:00.040060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:00.040358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:00.040615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:00.048783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:00.050383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe8c42-b612-4b76-b68c-301f09975ab4 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:00.060624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 693/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:02.680806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7973-0dc3-4c66-b2f1-a333c4e3790d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:02.681408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7973-0dc3-4c66-b2f1-a333c4e3790d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:02.681408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7973-0dc3-4c66-b2f1-a333c4e3790d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:02.682754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 696/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:02.688893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ef06-823d-40b5-b917-1e6eb8191233 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:02.689298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ef06-823d-40b5-b917-1e6eb8191233 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:02.689636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ef06-823d-40b5-b917-1e6eb8191233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:02.712800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2133ef06-823d-40b5-b917-1e6eb8191233 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:02.714470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2133ef06-823d-40b5-b917-1e6eb8191233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:02.724340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 694/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:02.778543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7973-0dc3-4c66-b2f1-a333c4e3790d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:02.796683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7973-0dc3-4c66-b2f1-a333c4e3790d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:02.804486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:02.805288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:02.805665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:02.806113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:02.817046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:02.819976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3241972-eb64-43b1-907f-0cf2bbfb39a4 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:02.832317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 697/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:05.279379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb720c-5f13-4145-a7f1-83c1a4608528 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:05.279987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb720c-5f13-4145-a7f1-83c1a4608528 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:05.279987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb720c-5f13-4145-a7f1-83c1a4608528 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:05.281264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 695/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:49:05.286505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b5d8-61fb-49ec-a30f-38fc91e28fe0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:05.286961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b5d8-61fb-49ec-a30f-38fc91e28fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:05.287256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b5d8-61fb-49ec-a30f-38fc91e28fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:05.305340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d5c1b5d8-61fb-49ec-a30f-38fc91e28fe0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:05.306534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d5c1b5d8-61fb-49ec-a30f-38fc91e28fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:05.314544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 698/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:05.358539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb720c-5f13-4145-a7f1-83c1a4608528 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:05.373585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb720c-5f13-4145-a7f1-83c1a4608528 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:05.378973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:05.379607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:05.379882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:05.380150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:05.389701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:05.391289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54678bee-6fec-44a8-bb65-602a115873d8 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:05.401395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 696/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:06.853295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b505ad0-d61d-4870-b212-a47b8f003ba0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:06.853855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b505ad0-d61d-4870-b212-a47b8f003ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:06.853855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b505ad0-d61d-4870-b212-a47b8f003ba0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:06.855179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 699/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:06.860317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170cb7a-df34-460a-9361-424a35131889 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:06.860753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170cb7a-df34-460a-9361-424a35131889 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:06.860850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170cb7a-df34-460a-9361-424a35131889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:06.878531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d170cb7a-df34-460a-9361-424a35131889 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:06.879694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d170cb7a-df34-460a-9361-424a35131889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:06.887554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 697/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:06.944827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176345-3c1b-46aa-bca1-6898af31cb83 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:06.945115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176345-3c1b-46aa-bca1-6898af31cb83 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:06.945391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176345-3c1b-46aa-bca1-6898af31cb83 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:06.946816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 700/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 5 14:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:06.951868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bb092-d2aa-492d-a30a-11b89646b15f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:06.952229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bb092-d2aa-492d-a30a-11b89646b15f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:06.952574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bb092-d2aa-492d-a30a-11b89646b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.000142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8c4bb092-d2aa-492d-a30a-11b89646b15f None None] MFA Rules not processed for user `986749ece20e480fb60caaea17d97655`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:07.001308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8c4bb092-d2aa-492d-a30a-11b89646b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:07.059110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 698/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 5 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:07.066870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176345-3c1b-46aa-bca1-6898af31cb83 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:07.077179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176345-3c1b-46aa-bca1-6898af31cb83 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:07.080610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:07.081236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.081515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.081826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.090700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:07.092115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9735d0-6861-4a78-ba83-5c9c92d22c21 service glance] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:07.102080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 701/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:07.539908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c76ba-2ca4-41e3-81d3-10debaade2cb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.540230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c76ba-2ca4-41e3-81d3-10debaade2cb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.540506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c76ba-2ca4-41e3-81d3-10debaade2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.589096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b29c76ba-2ca4-41e3-81d3-10debaade2cb None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:07.590301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b29c76ba-2ca4-41e3-81d3-10debaade2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:07.652878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 699/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:07.698115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012fcc-2007-4f92-84ad-f04e553fd4fd None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.698400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012fcc-2007-4f92-84ad-f04e553fd4fd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.698675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012fcc-2007-4f92-84ad-f04e553fd4fd None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.700034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 702/1401] 10.222.0.48 () {54 vars in 942 bytes} [Thu May 5 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:07.706168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.706457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.706733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.714500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296205-8115-4755-83e5-4ab08258229e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.714780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296205-8115-4755-83e5-4ab08258229e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.715077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296205-8115-4755-83e5-4ab08258229e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.716385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 703/1402] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:49:07.721272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.721616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.722009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.739864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:07.741733 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:07.749395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 704/1403] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:07.755595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] MFA Rules not processed for user `31f29b5255954eb7acd1c00773731200`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:07.757744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:07.795269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:07.808081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add580a8-e1ef-4348-a9b4-f98f64ca84a7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:07.813563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:07.814215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.814489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.814757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.823466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:07.825031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a523dd-9831-4d33-b2fd-fe9dabfce866 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:07.827929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 700/1404] 10.222.0.48 () {58 vars in 1039 bytes} [Thu May 5 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:07.835098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 705/1405] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:49:07.837962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:07.847376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46975b3c-dc7f-4594-8e02-24ffb178912b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:07.854113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:07.854753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:07.855030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:07.855296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:07.866001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:07.867589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab424d-aeca-4767-a147-8135fb2eed28 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:07.875909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 701/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:49:10.212632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08276e-081d-43bc-80d8-8d93f6dd52df None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:10.213189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08276e-081d-43bc-80d8-8d93f6dd52df None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:10.213189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08276e-081d-43bc-80d8-8d93f6dd52df None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:10.214803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 706/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:10.220283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413bbf-96b4-4604-b490-c3ccb2771a1d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:10.221087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413bbf-96b4-4604-b490-c3ccb2771a1d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:10.221365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413bbf-96b4-4604-b490-c3ccb2771a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:10.243179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6d413bbf-96b4-4604-b490-c3ccb2771a1d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:10.244364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6d413bbf-96b4-4604-b490-c3ccb2771a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:10.252279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 702/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:10.298391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08276e-081d-43bc-80d8-8d93f6dd52df None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:10.312387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08276e-081d-43bc-80d8-8d93f6dd52df None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:10.318033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:10.318717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:10.319086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:10.319362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:10.327689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:10.329474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d593f3-8778-46ee-bf02-1f12f08636ce service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:10.340105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 707/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:31.353521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbb0e-d7a6-44d6-927e-25843aa8b9a6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:31.354205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbb0e-d7a6-44d6-927e-25843aa8b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:31.354320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbb0e-d7a6-44d6-927e-25843aa8b9a6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:31.355597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 703/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 5 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:31.360887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1cf4d-e683-4731-b7a9-c9c664069d4a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:31.361369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1cf4d-e683-4731-b7a9-c9c664069d4a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:31.361478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1cf4d-e683-4731-b7a9-c9c664069d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:31.379001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-23b1cf4d-e683-4731-b7a9-c9c664069d4a None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:31.380270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-23b1cf4d-e683-4731-b7a9-c9c664069d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:31.388946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 708/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 5 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:31.403198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863f7-2787-4faa-b779-fa5f464fd985 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:31.403490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863f7-2787-4faa-b779-fa5f464fd985 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:31.403771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad863f7-2787-4faa-b779-fa5f464fd985 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:31.405126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 704/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 5 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:31.409630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf327-bf20-430d-ad90-48df969a84a9 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:31.409952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf327-bf20-430d-ad90-48df969a84a9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:31.410232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf327-bf20-430d-ad90-48df969a84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:31.428055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-675bf327-bf20-430d-ad90-48df969a84a9 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:31.429230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-675bf327-bf20-430d-ad90-48df969a84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:31.438573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 5 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:34.154788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623447-d01a-46c9-8af2-e0fa1fc43303 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:34.155357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623447-d01a-46c9-8af2-e0fa1fc43303 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:34.155357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623447-d01a-46c9-8af2-e0fa1fc43303 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:34.156655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:34.162372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bef1-320e-4bdb-882c-6959191d04de None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:34.162887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bef1-320e-4bdb-882c-6959191d04de None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:34.163006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bef1-320e-4bdb-882c-6959191d04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:34.181025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-cd82bef1-320e-4bdb-882c-6959191d04de None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:34.182364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cd82bef1-320e-4bdb-882c-6959191d04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:34.190973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:34.233471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623447-d01a-46c9-8af2-e0fa1fc43303 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:34.247239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623447-d01a-46c9-8af2-e0fa1fc43303 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:34.252466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:34.253093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:34.253382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:34.253635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:34.261603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:34.263180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336d9a-b1ef-44a8-939f-88c6679749ed service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:34.272787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 706/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:35.564803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b9dc-7f9e-4ee3-87e9-cbd9296b30f0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:35.565347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b9dc-7f9e-4ee3-87e9-cbd9296b30f0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:35.565347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b9dc-7f9e-4ee3-87e9-cbd9296b30f0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:35.566761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:35.572109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b215-bbfd-4e39-903f-3aab60b0bd69 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:35.572568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b215-bbfd-4e39-903f-3aab60b0bd69 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:35.572665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b215-bbfd-4e39-903f-3aab60b0bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:35.590537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-feb0b215-bbfd-4e39-903f-3aab60b0bd69 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:35.591706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-feb0b215-bbfd-4e39-903f-3aab60b0bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:35.599615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:35.762794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849b9dc-7f9e-4ee3-87e9-cbd9296b30f0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:35.777097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849b9dc-7f9e-4ee3-87e9-cbd9296b30f0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:35.782411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:35.783028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:35.783307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:35.783579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:35.792579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:35.794229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a05bb4-3755-402e-ae00-6684f16a7daf service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:35.804269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 712/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:37.069918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c6cf2-2acc-41b1-9e81-2a3c8be34679 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:37.070558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c6cf2-2acc-41b1-9e81-2a3c8be34679 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:37.070558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c6cf2-2acc-41b1-9e81-2a3c8be34679 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:37.071864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:37.076831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356b4bd-2d3b-4620-aa3f-f92eb94b45f5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:37.077235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356b4bd-2d3b-4620-aa3f-f92eb94b45f5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:37.077381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356b4bd-2d3b-4620-aa3f-f92eb94b45f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:37.096112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a356b4bd-2d3b-4620-aa3f-f92eb94b45f5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:37.097321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a356b4bd-2d3b-4620-aa3f-f92eb94b45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:37.105843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:37.258484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c6cf2-2acc-41b1-9e81-2a3c8be34679 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:37.273000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c6cf2-2acc-41b1-9e81-2a3c8be34679 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:37.278265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:37.278889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:37.279165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:37.279432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:37.287823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:37.289369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27729-53eb-4381-b6f6-69c99bf2e974 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:37.298515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 709/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:38.561673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e586dc3-fb76-44da-a829-e4c5aa02350d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:38.562230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e586dc3-fb76-44da-a829-e4c5aa02350d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:38.562230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e586dc3-fb76-44da-a829-e4c5aa02350d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:38.563841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:38.569773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf56f-cbad-43dc-aa4b-5c052ae4a496 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:38.570235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf56f-cbad-43dc-aa4b-5c052ae4a496 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:38.570346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf56f-cbad-43dc-aa4b-5c052ae4a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:38.588557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-20edf56f-cbad-43dc-aa4b-5c052ae4a496 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:38.589797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-20edf56f-cbad-43dc-aa4b-5c052ae4a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:38.597425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:38.746853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e586dc3-fb76-44da-a829-e4c5aa02350d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:38.761175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e586dc3-fb76-44da-a829-e4c5aa02350d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:38.766453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:38.767076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:38.767353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:38.767628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:38.775513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:38.777072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070e1be-cb17-497d-b20f-a3994a03b597 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:38.786095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 715/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:40.032616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3d86-45d4-4ce2-b423-c3f64e3fe821 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:40.033183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3d86-45d4-4ce2-b423-c3f64e3fe821 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:40.033183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3d86-45d4-4ce2-b423-c3f64e3fe821 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:40.034537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:40.039289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510536-5d25-48d6-9974-3eb38dfcdeba None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:40.039725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510536-5d25-48d6-9974-3eb38dfcdeba None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:40.039833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510536-5d25-48d6-9974-3eb38dfcdeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:40.057302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-08510536-5d25-48d6-9974-3eb38dfcdeba None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:40.058510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-08510536-5d25-48d6-9974-3eb38dfcdeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:40.066796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:40.217875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af3d86-45d4-4ce2-b423-c3f64e3fe821 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:40.232214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af3d86-45d4-4ce2-b423-c3f64e3fe821 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:40.237480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:40.238133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:40.238412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:40.238681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:40.246888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:40.248447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7adb2-1e9c-4ddf-8a47-66d0a2b2fa55 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:40.257491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 712/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:41.451518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085caa50-f1ea-45a3-9fea-e8f697f062dd None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:41.451960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085caa50-f1ea-45a3-9fea-e8f697f062dd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:41.452172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085caa50-f1ea-45a3-9fea-e8f697f062dd None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:41.453816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:41.458713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cb7d-aee5-4856-a152-164f4ff651e9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:41.459122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cb7d-aee5-4856-a152-164f4ff651e9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:41.459122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cb7d-aee5-4856-a152-164f4ff651e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:41.477753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-46b1cb7d-aee5-4856-a152-164f4ff651e9 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:41.478947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-46b1cb7d-aee5-4856-a152-164f4ff651e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:41.486553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:41.636689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085caa50-f1ea-45a3-9fea-e8f697f062dd None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:41.650624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085caa50-f1ea-45a3-9fea-e8f697f062dd None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:41.655838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:41.656459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:41.656737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:41.657009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:41.665890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:41.667441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652efa-6a94-41e8-b85a-83dc59296acb service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:41.676803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 718/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:42.936557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9a4b-d2ea-4a77-bd3e-7523c53e38c4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:42.937124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9a4b-d2ea-4a77-bd3e-7523c53e38c4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:42.937124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9a4b-d2ea-4a77-bd3e-7523c53e38c4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:42.938773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:42.943833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc695f-1827-4a94-9a59-68485cccadf0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:42.944339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc695f-1827-4a94-9a59-68485cccadf0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:42.944451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc695f-1827-4a94-9a59-68485cccadf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:42.965031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-3cbc695f-1827-4a94-9a59-68485cccadf0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:42.966252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3cbc695f-1827-4a94-9a59-68485cccadf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:42.974780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:43.155648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9a4b-d2ea-4a77-bd3e-7523c53e38c4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:43.170094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9a4b-d2ea-4a77-bd3e-7523c53e38c4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:43.175339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:43.175965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:43.176241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:43.176508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:43.184884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:43.186467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f36d-83c8-4583-865f-b99b14b33f18 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:43.195749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 715/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:44.390613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16813f1-07ce-4973-abbc-127c4efbd1f4 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:44.391180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16813f1-07ce-4973-abbc-127c4efbd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:44.391180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16813f1-07ce-4973-abbc-127c4efbd1f4 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:44.392574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:44.397742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c983b-9dd0-4c99-a08a-328a9398c23b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:44.398217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c983b-9dd0-4c99-a08a-328a9398c23b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:44.398358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c983b-9dd0-4c99-a08a-328a9398c23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:44.417395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-134c983b-9dd0-4c99-a08a-328a9398c23b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:44.418874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-134c983b-9dd0-4c99-a08a-328a9398c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:44.427527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:44.579056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16813f1-07ce-4973-abbc-127c4efbd1f4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:44.593066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16813f1-07ce-4973-abbc-127c4efbd1f4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:44.598439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:44.599658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:44.599867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:44.600141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:44.608417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:44.610026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1022b4-139c-4945-a609-a314d993cabd service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:44.620110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 721/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:45.804853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890e76-cffe-466a-98e7-1dbe9c18e024 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:45.805369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890e76-cffe-466a-98e7-1dbe9c18e024 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:45.805369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890e76-cffe-466a-98e7-1dbe9c18e024 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:45.806692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:45.811486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2609-94f8-46c7-b02c-71df756692fd None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:45.811892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2609-94f8-46c7-b02c-71df756692fd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:45.812041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2609-94f8-46c7-b02c-71df756692fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:45.830942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-751e2609-94f8-46c7-b02c-71df756692fd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:45.832111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-751e2609-94f8-46c7-b02c-71df756692fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:45.840005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:45.991764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b890e76-cffe-466a-98e7-1dbe9c18e024 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:46.005594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b890e76-cffe-466a-98e7-1dbe9c18e024 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:46.010907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:46.011538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:46.011814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:46.012082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:46.019881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:46.021454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae380ad-2309-463f-88a2-e79aa74b9239 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:46.030554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 718/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:48.204931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1ef2-aa69-41e3-ae05-2089f4b05229 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:48.205476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1ef2-aa69-41e3-ae05-2089f4b05229 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:48.205476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1ef2-aa69-41e3-ae05-2089f4b05229 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:48.206878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:48.213376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d18f-8536-4302-96e4-95ca2fa21e96 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:48.213842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d18f-8536-4302-96e4-95ca2fa21e96 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:48.213993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d18f-8536-4302-96e4-95ca2fa21e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:48.231040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-dea1d18f-8536-4302-96e4-95ca2fa21e96 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:48.232220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dea1d18f-8536-4302-96e4-95ca2fa21e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:48.239911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:48.279290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f1ef2-aa69-41e3-ae05-2089f4b05229 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:48.289787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f1ef2-aa69-41e3-ae05-2089f4b05229 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:48.293203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:48.293874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:48.294157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:48.294430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:48.303180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:48.304587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac38dee-3b81-4e4f-b1a7-29bc7fb218f4 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:48.313956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 724/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:50.710287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930f6c9-be2d-46f3-8f76-4e2a49ca1ccd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:50.710825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930f6c9-be2d-46f3-8f76-4e2a49ca1ccd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:50.710825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930f6c9-be2d-46f3-8f76-4e2a49ca1ccd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:50.712105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:50.717517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583619-dd18-49b5-b7e9-0bd7aeb3f52f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:50.717981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583619-dd18-49b5-b7e9-0bd7aeb3f52f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:50.718116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583619-dd18-49b5-b7e9-0bd7aeb3f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:50.736029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-cc583619-dd18-49b5-b7e9-0bd7aeb3f52f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:50.737208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cc583619-dd18-49b5-b7e9-0bd7aeb3f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:50.745539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:50.783449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930f6c9-be2d-46f3-8f76-4e2a49ca1ccd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:50.794067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930f6c9-be2d-46f3-8f76-4e2a49ca1ccd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:50.797492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:50.798153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:50.798431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:50.798700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:50.808617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:50.810080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d478bba-b801-46f0-bd8e-f947a0f7f7bf service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:50.820244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 721/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:53.349381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:53.350029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:53.350029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:53.351306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:53.356449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810196-39c1-4904-94a5-64e9c86030b1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:53.356904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810196-39c1-4904-94a5-64e9c86030b1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:53.357010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810196-39c1-4904-94a5-64e9c86030b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:53.374399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-09810196-39c1-4904-94a5-64e9c86030b1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:53.375571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-09810196-39c1-4904-94a5-64e9c86030b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:53.383853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:53.422712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:53.424421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:53.437708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0e104-aa58-4636-a3e6-e0bd699fd598 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:53.441366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:53.442021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:53.442927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:53.443751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:53.452674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:53.454126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692749b5-d37c-4912-8bd5-18dbe97d7cf5 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:53.464411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 727/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:55.879523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2de5d-a3df-4822-972f-9dd6216b3033 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:55.880564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2de5d-a3df-4822-972f-9dd6216b3033 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:55.880564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2de5d-a3df-4822-972f-9dd6216b3033 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:55.881923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:55.887050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf932e3-876d-4af9-8b75-1beb323e48ff None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:55.887455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf932e3-876d-4af9-8b75-1beb323e48ff None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:55.887600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf932e3-876d-4af9-8b75-1beb323e48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:55.905267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0bf932e3-876d-4af9-8b75-1beb323e48ff None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:55.906470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0bf932e3-876d-4af9-8b75-1beb323e48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:55.914217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:49:55.952849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2de5d-a3df-4822-972f-9dd6216b3033 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:55.964259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2de5d-a3df-4822-972f-9dd6216b3033 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:55.967734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:55.968393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:55.968674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:55.968946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:55.977538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:55.978988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2352b80-73d5-475e-9746-794842bfb74b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:55.988030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 724/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:49:58.296133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb800-dfa8-4cf0-b07c-95a21537483d None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:58.296706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb800-dfa8-4cf0-b07c-95a21537483d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:58.296706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb800-dfa8-4cf0-b07c-95a21537483d None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:58.298094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:49:58.303965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41423-fe07-40ff-9926-910f3dec3d3c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:58.304383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41423-fe07-40ff-9926-910f3dec3d3c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:58.304523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41423-fe07-40ff-9926-910f3dec3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:58.322471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-06c41423-fe07-40ff-9926-910f3dec3d3c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:49:58.323656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-06c41423-fe07-40ff-9926-910f3dec3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:49:58.331328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:49:58.369753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb800-dfa8-4cf0-b07c-95a21537483d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:49:58.381035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb800-dfa8-4cf0-b07c-95a21537483d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:49:58.384475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:49:58.385096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:49:58.385369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:49:58.385636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:49:58.394097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:49:58.396023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae215-aff6-4ddc-876e-51404825a054 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:49:58.405049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 730/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:00.767959 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5558-ea6d-4877-b796-3f0764190988 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:00.768506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5558-ea6d-4877-b796-3f0764190988 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:00.768506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5558-ea6d-4877-b796-3f0764190988 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:00.769781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:00.774959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411526-3f21-4a4f-b71c-f379fd3ba880 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:00.775388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411526-3f21-4a4f-b71c-f379fd3ba880 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:00.775503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411526-3f21-4a4f-b71c-f379fd3ba880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:00.792508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-58411526-3f21-4a4f-b71c-f379fd3ba880 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:00.793686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-58411526-3f21-4a4f-b71c-f379fd3ba880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:00.801123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:50:00.839963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5558-ea6d-4877-b796-3f0764190988 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:00.850743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5558-ea6d-4877-b796-3f0764190988 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:00.854172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:00.854794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:00.855067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:00.855333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:00.863692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:00.865674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445484a2-bf02-4f7c-bcd2-89598a3c2bc3 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:00.874492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 727/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:50:03.182053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889449-561d-4de5-a115-883ec888a396 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:03.182620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889449-561d-4de5-a115-883ec888a396 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:03.182620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889449-561d-4de5-a115-883ec888a396 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:03.183987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:03.189383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226153-9fed-412b-8b34-9b8cbc0bcac1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:03.189818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226153-9fed-412b-8b34-9b8cbc0bcac1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:03.189967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226153-9fed-412b-8b34-9b8cbc0bcac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:03.207237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-97226153-9fed-412b-8b34-9b8cbc0bcac1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:03.208519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-97226153-9fed-412b-8b34-9b8cbc0bcac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:03.216132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:03.253728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89889449-561d-4de5-a115-883ec888a396 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:03.264494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89889449-561d-4de5-a115-883ec888a396 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:03.267930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:03.268546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:03.268824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:03.269095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:03.278014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:03.279411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a024c-5e30-4644-ab74-f92b41dcb10e service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:03.289438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 733/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:05.601276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cf6c2-3500-4dc1-8197-16ed5d1a1890 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:05.601897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cf6c2-3500-4dc1-8197-16ed5d1a1890 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:05.601897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cf6c2-3500-4dc1-8197-16ed5d1a1890 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:05.603216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:05.608325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ecc1d-55b4-4bc3-b62d-1b5b564821ae None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:05.608724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ecc1d-55b4-4bc3-b62d-1b5b564821ae None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:05.608888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ecc1d-55b4-4bc3-b62d-1b5b564821ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:05.626722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8c2ecc1d-55b4-4bc3-b62d-1b5b564821ae None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:05.627889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8c2ecc1d-55b4-4bc3-b62d-1b5b564821ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:05.635737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:05.673679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cf6c2-3500-4dc1-8197-16ed5d1a1890 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:05.685017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cf6c2-3500-4dc1-8197-16ed5d1a1890 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:05.688440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:05.689339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:05.689620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:05.689935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:05.698803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:05.700216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fd61-ca78-4ebb-ae46-476da04f960c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:05.710120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 730/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:07.985659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6998-fbc1-4fbb-9c73-b45df86ce8af None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:07.986213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6998-fbc1-4fbb-9c73-b45df86ce8af None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:07.986213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6998-fbc1-4fbb-9c73-b45df86ce8af None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:07.987593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:07.992805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67279-f29e-4f89-9262-b16e0ca95468 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:07.993201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67279-f29e-4f89-9262-b16e0ca95468 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:07.993360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67279-f29e-4f89-9262-b16e0ca95468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:08.010663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-34e67279-f29e-4f89-9262-b16e0ca95468 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:08.011848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-34e67279-f29e-4f89-9262-b16e0ca95468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:08.019498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:08.056606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d6998-fbc1-4fbb-9c73-b45df86ce8af None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:08.067416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d6998-fbc1-4fbb-9c73-b45df86ce8af None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:08.070937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:08.071563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:08.071846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:08.072122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:08.081243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:08.083432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414e858-50ea-4786-9b57-4c5e05f69d9b service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:08.092752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 736/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:10.401776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4710a-905f-4ec1-931d-20dee5af4c3d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:10.402349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4710a-905f-4ec1-931d-20dee5af4c3d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:10.402349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4710a-905f-4ec1-931d-20dee5af4c3d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:10.403693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:10.408848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61a-bddb-4f0e-bef6-4d74162948a4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:10.409293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61a-bddb-4f0e-bef6-4d74162948a4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:10.409400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61a-bddb-4f0e-bef6-4d74162948a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:10.427559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-875ae61a-bddb-4f0e-bef6-4d74162948a4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:10.428744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-875ae61a-bddb-4f0e-bef6-4d74162948a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:10.436426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:10.473066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4710a-905f-4ec1-931d-20dee5af4c3d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:10.484092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4710a-905f-4ec1-931d-20dee5af4c3d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:10.487555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:10.488194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:10.488462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:10.488784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:10.497453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:10.498950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4baf9-5104-418a-9190-47aed05392ce service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:10.508603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 733/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:44.084959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3324-ac47-4c84-8b19-f02eb0eef163 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:44.085556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3324-ac47-4c84-8b19-f02eb0eef163 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:44.085556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3324-ac47-4c84-8b19-f02eb0eef163 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:44.086942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 738/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:44.092119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e649-c89c-4d55-a450-a1262761013c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:44.092555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e649-c89c-4d55-a450-a1262761013c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:44.092661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e649-c89c-4d55-a450-a1262761013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:44.110747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c986e649-c89c-4d55-a450-a1262761013c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:44.111914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c986e649-c89c-4d55-a450-a1262761013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:44.120126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 734/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:44.167754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fe9b6-40e8-460d-91e5-b05aefcc2051 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:44.168039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fe9b6-40e8-460d-91e5-b05aefcc2051 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:44.168313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fe9b6-40e8-460d-91e5-b05aefcc2051 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:44.169662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 739/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 5 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:44.174225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f24ea-befa-49b9-8a92-d998deff72cc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:44.174514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f24ea-befa-49b9-8a92-d998deff72cc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:44.174817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f24ea-befa-49b9-8a92-d998deff72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:44.192572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a06f24ea-befa-49b9-8a92-d998deff72cc None None] MFA Rules not processed for user `986749ece20e480fb60caaea17d97655`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:44.193783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a06f24ea-befa-49b9-8a92-d998deff72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:44.200349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 735/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 5 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:44.208333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fe9b6-40e8-460d-91e5-b05aefcc2051 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:44.218879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fe9b6-40e8-460d-91e5-b05aefcc2051 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:44.223522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:44.224152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:44.224432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:44.224705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:44.233823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:44.235234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3d72-6790-41d2-afde-c055f01f892b service glance] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:44.244346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 740/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:50:46.600534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1e05-1ec6-4b55-8741-dcdb4bc40692 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:46.601066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1e05-1ec6-4b55-8741-dcdb4bc40692 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:46.601066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1e05-1ec6-4b55-8741-dcdb4bc40692 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:46.602609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 736/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:46.607635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905006d4-0021-4fda-b40a-dcd002a078e8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:46.608066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905006d4-0021-4fda-b40a-dcd002a078e8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:46.608176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905006d4-0021-4fda-b40a-dcd002a078e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:46.625962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-905006d4-0021-4fda-b40a-dcd002a078e8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:46.627130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-905006d4-0021-4fda-b40a-dcd002a078e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:46.634951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 741/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:46.657904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f1e05-1ec6-4b55-8741-dcdb4bc40692 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:46.670905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f1e05-1ec6-4b55-8741-dcdb4bc40692 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:46.676263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:46.676898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:46.677174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:46.677444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:46.678202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:46.679932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:50:46.679932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:50:46.679932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:50:46.681105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd4ffd-a6e6-4142-be92-4e8ab33e9738 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:46.699568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 737/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 5 14:50:46 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:50:48.971027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28e45-5aba-4e41-a885-ab397bc4d17a None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:48.971592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28e45-5aba-4e41-a885-ab397bc4d17a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:48.971592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28e45-5aba-4e41-a885-ab397bc4d17a None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:48.973172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 742/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:48.978392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53c7c-3b2e-412d-bfe9-53712a29ccff None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:48.978798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53c7c-3b2e-412d-bfe9-53712a29ccff None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:48.978956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53c7c-3b2e-412d-bfe9-53712a29ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:48.996775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e0d53c7c-3b2e-412d-bfe9-53712a29ccff None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:48.998069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e0d53c7c-3b2e-412d-bfe9-53712a29ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:49.006516 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 738/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:49.048398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d28e45-5aba-4e41-a885-ab397bc4d17a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:49.062476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d28e45-5aba-4e41-a885-ab397bc4d17a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:49.068755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:49.069379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:49.069686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:49.069966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:49.077833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:49.079397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7753bd-71f0-4ca9-940f-1ed7194fde94 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:49.089554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 743/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:51.525836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce620-22ce-4d05-9d6c-f98e55b3282e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:51.526381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce620-22ce-4d05-9d6c-f98e55b3282e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:51.526381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce620-22ce-4d05-9d6c-f98e55b3282e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:51.527752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 739/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:51.534053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789cb1-c826-4f5a-a111-b1d7dd25e7e5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:51.535711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789cb1-c826-4f5a-a111-b1d7dd25e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:51.535711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789cb1-c826-4f5a-a111-b1d7dd25e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:51.552737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-52789cb1-c826-4f5a-a111-b1d7dd25e7e5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:51.553977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-52789cb1-c826-4f5a-a111-b1d7dd25e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:51.561536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 744/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:51.598147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bce620-22ce-4d05-9d6c-f98e55b3282e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:51.608496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bce620-22ce-4d05-9d6c-f98e55b3282e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:51.611932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:51.613193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:51.613467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:51.613775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:51.622552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:51.623961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014aada-8878-48e2-bcb1-056778240b04 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:51.633281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 740/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:53.925562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd830-830d-40b5-9bbb-c70b8dd2e43b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:53.926299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd830-830d-40b5-9bbb-c70b8dd2e43b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:53.926299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd830-830d-40b5-9bbb-c70b8dd2e43b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:53.927552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 745/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:53.932611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0952-0c1b-48a9-bbe3-283842713a9a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:53.933030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0952-0c1b-48a9-bbe3-283842713a9a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:53.933157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0952-0c1b-48a9-bbe3-283842713a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:53.951143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1bcb0952-0c1b-48a9-bbe3-283842713a9a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:53.952309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1bcb0952-0c1b-48a9-bbe3-283842713a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:53.959940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 741/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:53.997689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdd830-830d-40b5-9bbb-c70b8dd2e43b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:54.008911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdd830-830d-40b5-9bbb-c70b8dd2e43b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:54.012451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:54.013106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:54.013389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:54.013694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:54.022392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:54.023803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5540f-8925-4c7b-af81-79a0a90ff8de service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:54.032864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 746/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:56.355787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7950-4c9c-4fdd-b3bd-d65a7d227296 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:56.356374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7950-4c9c-4fdd-b3bd-d65a7d227296 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:56.356374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7950-4c9c-4fdd-b3bd-d65a7d227296 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:56.357700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 742/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:56.363279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a596afe-53bf-4d42-b83d-8459ed511639 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:56.363739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a596afe-53bf-4d42-b83d-8459ed511639 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:56.363850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a596afe-53bf-4d42-b83d-8459ed511639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:56.381361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5a596afe-53bf-4d42-b83d-8459ed511639 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:56.382571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5a596afe-53bf-4d42-b83d-8459ed511639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:56.390184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 747/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:56.431246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7950-4c9c-4fdd-b3bd-d65a7d227296 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:56.442536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7950-4c9c-4fdd-b3bd-d65a7d227296 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:56.446017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:56.446642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:56.446914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:56.447181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:56.455885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:56.458074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a721f-de3a-4a1c-a7b7-14de1c9177b3 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:56.467428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 743/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:50:58.890007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c09e9-8815-47c7-a775-38216f1660aa None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:58.890563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c09e9-8815-47c7-a775-38216f1660aa None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:58.890563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c09e9-8815-47c7-a775-38216f1660aa None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:58.891881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 748/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 5 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:50:58.897165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a420-e795-446b-abc4-dfd8c24a02fd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:58.897591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a420-e795-446b-abc4-dfd8c24a02fd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:58.897754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a420-e795-446b-abc4-dfd8c24a02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:58.915580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-22f1a420-e795-446b-abc4-dfd8c24a02fd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:50:58.916758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-22f1a420-e795-446b-abc4-dfd8c24a02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:50:58.924686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 744/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 5 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:50:58.965032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c09e9-8815-47c7-a775-38216f1660aa None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:50:58.976135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c09e9-8815-47c7-a775-38216f1660aa None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:50:58.979531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:50:58.980154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:50:58.980433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:50:58.980706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:50:58.989555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:50:58.990982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d7bc6-88ed-4965-aa3f-77583731453d service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:50:59.000049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 749/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:52:38.680710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8258-606b-458a-8145-69f95292442c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.681278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8258-606b-458a-8145-69f95292442c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.681278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8258-606b-458a-8145-69f95292442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.700366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a30b8258-606b-458a-8145-69f95292442c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:52:38.701543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a30b8258-606b-458a-8145-69f95292442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:38.709853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 745/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:52:38.717703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.718184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.718295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.735655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:52:38.736822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:38.744369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 750/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:52:38.748909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b8258-606b-458a-8145-69f95292442c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:38.758991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b8258-606b-458a-8145-69f95292442c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:38.763427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:38.764070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.764350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.764623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.765338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:52:38.765660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:38.767276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:38.767276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:52:38.767276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:52:38.768099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:38.779287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 746/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:52:38.787255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:38.796034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046321a8-af02-4db4-94e6-6154a6037408 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:38.800658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:38.801292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.801573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.801875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.802555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:38.804300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:38.804300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:52:38.804300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:52:38.805475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:38.842238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 751/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:52:38 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:52:38.846977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:38.856634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0656f-8bb2-4ae9-95b4-45df431dfed3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:38.909845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:38.910503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.910779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.911050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.911772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:38.912795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:38.912795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:52:38.912795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:52:38.914004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:38.933043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 747/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:52:38 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:52:38.937180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:38.948470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cf25b-75a3-45c2-a17a-8505de88b000 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:38.952876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:38.953526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.954872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.955159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.955880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:38.956873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:38.956873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:52:38.956873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:52:38.957765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:38.970300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 752/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:52:38.974174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:38.983747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a083a-1061-4b46-b5cd-bf9869b61bf7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:38.988308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:38.988955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:38.989232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:38.989505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:38.990258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:38.991411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:38.991411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:52:38.991411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:52:38.992282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a5bb3-ec35-4281-a34d-ce9337e73f61 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:39.006308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 748/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:52:39.010415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:39.021243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e360-221c-4f53-ba25-230c580b43e4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:39.025604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:39.026487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.026762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.027029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] PATH_INFO: `/v3/projects/57335cff213444e0b9362ba18656824e/users/723a91a764f748fcbb828e017612b1a2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.041262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57335cff213444e0b9362ba18656824e, user_id=723a91a764f748fcbb828e017612b1a2, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:39.042309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:39.042309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:52:39.042309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:52:39.044197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:39.057832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 753/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:52:39 2022] PUT /identity/v3/projects/57335cff213444e0b9362ba18656824e/users/723a91a764f748fcbb828e017612b1a2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:52:39.069736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d206-b915-4d70-b433-d14e1e814176 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.070025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d206-b915-4d70-b433-d14e1e814176 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.070301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d206-b915-4d70-b433-d14e1e814176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.095325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9d31d206-b915-4d70-b433-d14e1e814176 None None] MFA Rules not processed for user `723a91a764f748fcbb828e017612b1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:52:39.096744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9d31d206-b915-4d70-b433-d14e1e814176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:39.156697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 749/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:52:39.167463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:39.234062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db4b32-8bd0-490f-97bc-0ccf8101dcb0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:39.239965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:39.240599 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.240878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.241153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.248558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:39.250168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:39.259464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 754/1503] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:52:39.328683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe7f-eb87-40df-a00d-e549f5e81faf None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.328977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe7f-eb87-40df-a00d-e549f5e81faf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.329256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe7f-eb87-40df-a00d-e549f5e81faf None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.330606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 750/1504] 10.222.0.48 () {52 vars in 829 bytes} [Thu May 5 14:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:52:39.334318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:39.398425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f0d-d64d-48ca-874d-e43c10c281d9 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:39.402893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:39.403738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.404013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.404278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] PATH_INFO: `/v3/users/723a91a764f748fcbb828e017612b1a2` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.405431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] RBAC: Authorizing `identity:delete_user(user_id=723a91a764f748fcbb828e017612b1a2)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:39.406466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:39.406466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:52:39.406466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:52:39.407641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:39.474779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723a91a764f748fcbb828e017612b1a2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:39.475439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723a91a764f748fcbb828e017612b1a2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:39.476133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723a91a764f748fcbb828e017612b1a2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:39.494408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723a91a764f748fcbb828e017612b1a2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:39.503380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723a91a764f748fcbb828e017612b1a2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:39.520660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 755/1505] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:52:39 2022] DELETE /identity/v3/users/723a91a764f748fcbb828e017612b1a2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:52:39.525181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.525468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.525803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.544742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:52:39.545940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:39.601514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 751/1506] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:52:39.610873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:39.612857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:39.667336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa05-2420-4caa-8d02-c2570cfd811c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:39.670861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:39.671500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:39.671781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:39.672056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:39.681563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:39.683011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3168-2851-466d-b483-9756e48e383e service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:39.692646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 756/1507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:52:40.037479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:52:40.039046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:52:40.051089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bf0a0-945e-4dee-b73c-d050124fd6fa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:52:40.056265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:52:40.057000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:52:40.057282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:52:40.059768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] PATH_INFO: `/v3/projects/57335cff213444e0b9362ba18656824e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:52:40.059768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57335cff213444e0b9362ba18656824e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:52:40.059768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:52:40.059768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:52:40.059768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:52:40.060904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:52:40.124238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57335cff213444e0b9362ba18656824e', 'request_id': 'req-9ad6142e-c436-48f9-b7f7-d7f92c29e729'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:40.130660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57335cff213444e0b9362ba18656824e', 'request_id': 'req-9ad6142e-c436-48f9-b7f7-d7f92c29e729'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:40.144356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57335cff213444e0b9362ba18656824e', 'request_id': 'req-9ad6142e-c436-48f9-b7f7-d7f92c29e729'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:40.159247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] The token cache is being invalidate because project 57335cff213444e0b9362ba18656824e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:52:40.159529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:40.160151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ad6142e-c436-48f9-b7f7-d7f92c29e729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:52:40.161771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 752/1508] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:52:40 2022] DELETE /identity/v3/projects/57335cff213444e0b9362ba18656824e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:54:24.591539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:24.592148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:24.592261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:24.593778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 757/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:24.598819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542411a5-800d-4667-8dac-28ba731934ea None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:24.599271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542411a5-800d-4667-8dac-28ba731934ea None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:24.599366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542411a5-800d-4667-8dac-28ba731934ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:24.617443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-542411a5-800d-4667-8dac-28ba731934ea None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:24.618669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-542411a5-800d-4667-8dac-28ba731934ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:24.676517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 753/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:54:24.833514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:24.835330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:24.890435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9db11-d8bb-4259-a779-a4ed66cdc46e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:24.890716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9db11-d8bb-4259-a779-a4ed66cdc46e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:24.890993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9db11-d8bb-4259-a779-a4ed66cdc46e None None] PATH_INFO: `/v3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:24.892307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 754/1511] 10.222.0.25 () {54 vars in 925 bytes} [Thu May 5 14:54:24 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:54:24.898551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6515b0-d4cf-4501-a07d-95c8f08fbf29 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:24.898862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6515b0-d4cf-4501-a07d-95c8f08fbf29 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:24.899137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6515b0-d4cf-4501-a07d-95c8f08fbf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:24.908663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87d85-e0d5-467f-9e1f-6d7774efd407 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:24.914176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:24.914825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:24.915108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:24.915387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:24.918902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7c6515b0-d4cf-4501-a07d-95c8f08fbf29 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:24.920835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7c6515b0-d4cf-4501-a07d-95c8f08fbf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:24.924524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:24.926187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e3403-588e-4b3a-a693-df9fd5bec94d service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:24.936409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 758/1512] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:25.114520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 755/1513] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 5 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:54:26.177388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0995-2730-4ffe-8757-5aac0db6c85b None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:26.177967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0995-2730-4ffe-8757-5aac0db6c85b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:26.177967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0995-2730-4ffe-8757-5aac0db6c85b None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:26.179342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:26.184050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834249b-0476-4a1c-94ad-cefcee52cba9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:26.184494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834249b-0476-4a1c-94ad-cefcee52cba9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:26.184610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834249b-0476-4a1c-94ad-cefcee52cba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:26.202495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0834249b-0476-4a1c-94ad-cefcee52cba9 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:26.203672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0834249b-0476-4a1c-94ad-cefcee52cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:26.211321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:26.364163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed0995-2730-4ffe-8757-5aac0db6c85b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:26.378610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed0995-2730-4ffe-8757-5aac0db6c85b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:26.383932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:26.384560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:26.384846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:26.385123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:26.393551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:26.395131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0006a-c90c-430d-8b96-adcee6de8fc2 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:26.404309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 760/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:34.010394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c7612-07b2-4c1d-a273-998e48cc141e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:34.010976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c7612-07b2-4c1d-a273-998e48cc141e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:34.010976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c7612-07b2-4c1d-a273-998e48cc141e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:34.012267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 757/1517] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:34.017439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9101-17c6-427b-a6de-20b8ef167c45 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:34.017931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9101-17c6-427b-a6de-20b8ef167c45 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:34.018037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff9101-17c6-427b-a6de-20b8ef167c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:34.036622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2aff9101-17c6-427b-a6de-20b8ef167c45 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:34.037740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2aff9101-17c6-427b-a6de-20b8ef167c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:34.046958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 761/1518] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:54:34.054826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c7612-07b2-4c1d-a273-998e48cc141e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:34.068126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c7612-07b2-4c1d-a273-998e48cc141e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:34.072880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:34.073501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:34.073813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:34.074088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:34.082044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:34.083645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c962-71b4-4a33-a429-2756c574696b service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:34.094202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 758/1519] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:38.026226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629c70-bbb3-45a7-9d46-2d0fd5ffa318 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:38.026800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629c70-bbb3-45a7-9d46-2d0fd5ffa318 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:38.026800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629c70-bbb3-45a7-9d46-2d0fd5ffa318 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:38.028128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 762/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:38.033272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9a9f-4ba4-41af-b6ae-767ebf03b886 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:38.033730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9a9f-4ba4-41af-b6ae-767ebf03b886 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:38.033843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9a9f-4ba4-41af-b6ae-767ebf03b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:38.051797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-61ae9a9f-4ba4-41af-b6ae-767ebf03b886 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:38.052914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61ae9a9f-4ba4-41af-b6ae-767ebf03b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:38.060603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 759/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:38.213671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629c70-bbb3-45a7-9d46-2d0fd5ffa318 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:38.228125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629c70-bbb3-45a7-9d46-2d0fd5ffa318 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:38.234552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:38.235170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:38.235447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:38.235717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:38.243452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:38.245010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f00e-5c4a-4726-9ce0-081cdc4aa794 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:38.255219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 763/1522] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:39.510443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762a5c-db47-4fb9-aecb-9ea6b6875c98 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:39.511008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762a5c-db47-4fb9-aecb-9ea6b6875c98 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:39.511008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762a5c-db47-4fb9-aecb-9ea6b6875c98 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:39.512338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 760/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 14:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:39.517838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cab5c-5558-4c9c-b73c-2e18a4463f3c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:39.518232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cab5c-5558-4c9c-b73c-2e18a4463f3c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:39.518387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cab5c-5558-4c9c-b73c-2e18a4463f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:39.535747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-921cab5c-5558-4c9c-b73c-2e18a4463f3c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:39.536917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-921cab5c-5558-4c9c-b73c-2e18a4463f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:39.544510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 764/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:39.696647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762a5c-db47-4fb9-aecb-9ea6b6875c98 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:39.710444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762a5c-db47-4fb9-aecb-9ea6b6875c98 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:39.715681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:39.716308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:39.716584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:39.716881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:39.724905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:39.726560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfca66-7fed-42c6-be9f-1dc5888943fe service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:39.736326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 761/1525] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:44.214530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:44.215070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:44.215070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:44.216441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 765/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:44.221716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f46fe-744f-4a28-8754-da04131fbf34 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:44.222114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f46fe-744f-4a28-8754-da04131fbf34 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:44.222265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f46fe-744f-4a28-8754-da04131fbf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:44.240260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-814f46fe-744f-4a28-8754-da04131fbf34 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:44.241426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-814f46fe-744f-4a28-8754-da04131fbf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:44.249566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 762/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:44.286023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:44.287700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:44.344992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342fb9-ec74-45ff-90fb-d966c2245644 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:44.348609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:44.349252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:44.349529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:44.349836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:44.361072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:44.362572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd554a-193c-485e-ad97-017d51fdba46 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:44.374501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 766/1528] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:46.688664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:46.689227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:46.689227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:46.690871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 763/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:46.696011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d545f8-9ea0-420a-9e22-3675a3557353 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:46.696427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d545f8-9ea0-420a-9e22-3675a3557353 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:46.696565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d545f8-9ea0-420a-9e22-3675a3557353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:46.715158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-23d545f8-9ea0-420a-9e22-3675a3557353 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:46.716342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-23d545f8-9ea0-420a-9e22-3675a3557353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:46.724045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 767/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:46.759678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:46.761342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:46.774549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834350c-5e5c-4b40-acf7-df590b986710 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:46.778041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:46.778672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:46.778950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:46.779360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:46.788077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:46.789493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646129-f2c7-4067-9bbd-a8eaad95037f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:46.798791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 764/1531] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:50.707815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:50.708342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:50.708342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:50.709688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 768/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:50.714814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d4fe-dc89-4885-8aa6-e5dee2ce51c4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:50.715310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d4fe-dc89-4885-8aa6-e5dee2ce51c4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:50.715472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d4fe-dc89-4885-8aa6-e5dee2ce51c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:50.734107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ec31d4fe-dc89-4885-8aa6-e5dee2ce51c4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:50.735287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ec31d4fe-dc89-4885-8aa6-e5dee2ce51c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:50.743068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 765/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:51.015947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:51.017708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:51.074631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f14f5-1853-44d0-bbfe-31c0dc3ae1b0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:51.078127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:51.078754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:51.079050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:51.079303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:51.087705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:51.089105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4270e8-32d2-430d-a051-27b8f0f2c672 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:51.098903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 769/1534] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:54:53.394520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933027-3311-4ed1-9ec2-a844da6cc00e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:53.395064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933027-3311-4ed1-9ec2-a844da6cc00e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:53.395064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933027-3311-4ed1-9ec2-a844da6cc00e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:53.396446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 766/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 14:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:53.401610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9098-5eca-40a1-861b-cf6e3d3c632d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:53.402077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9098-5eca-40a1-861b-cf6e3d3c632d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:53.402192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9098-5eca-40a1-861b-cf6e3d3c632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:53.420507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-55fc9098-5eca-40a1-861b-cf6e3d3c632d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:53.421720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-55fc9098-5eca-40a1-861b-cf6e3d3c632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:53.429462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 770/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:53.722441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe6a6-c014-4f86-8ca0-2196069b4d60 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:53.722732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe6a6-c014-4f86-8ca0-2196069b4d60 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:53.723009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe6a6-c014-4f86-8ca0-2196069b4d60 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:53.724371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 767/1537] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 5 14:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:54:53.729078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48a35-190c-4d70-8961-681775383635 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:53.729369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48a35-190c-4d70-8961-681775383635 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:53.729678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48a35-190c-4d70-8961-681775383635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:53.747820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f0a48a35-190c-4d70-8961-681775383635 None None] MFA Rules not processed for user `7d1bd23334ec406f81303f12c5672889`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:54:53.748995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f0a48a35-190c-4d70-8961-681775383635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:54:53.755307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 771/1538] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 5 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:54:53.762580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe6a6-c014-4f86-8ca0-2196069b4d60 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:54:53.773462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe6a6-c014-4f86-8ca0-2196069b4d60 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:54:53.777547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:54:53.778272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:54:53.778697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:54:53.779720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:54:53.791262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:54:53.793347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c19a3-7fc6-4cb4-9bb7-842dd4c7814e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:54:53.802510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 768/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:56:25.041256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.042506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.043021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.075156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:25.077290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:25.089675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 772/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:25.099674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.100273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.100273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.130385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:25.131741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:25.145205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 769/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:25.155007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.192029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f402-5cd0-4a33-b3a3-9349cc4feae9 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.197750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.198827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.199331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.199827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.200787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:25.205571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.211199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:25.211199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:56:25.211199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:56:25.212530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36634-fdda-4178-bcb4-10a65c851509 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.239353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 773/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:25.248300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.262507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df3afe-a480-4ab6-91a0-9c1b3da317d6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.286699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.287387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.287664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.287936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.288635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.289676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:25.289676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:56:25.289676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:56:25.291009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.331397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8e52-43d4-44fd-b385-dda4f4f3b3b3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.332097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8e52-43d4-44fd-b385-dda4f4f3b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.332401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 770/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:25.332840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8e52-43d4-44fd-b385-dda4f4f3b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.338002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.367689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-433f8e52-43d4-44fd-b385-dda4f4f3b3b3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:25.374421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-433f8e52-43d4-44fd-b385-dda4f4f3b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:25.487215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9006-f6d4-44b2-a52e-71e39bf7d09d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.503015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.503722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.504011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.506913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.507668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.509679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.515914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 774/1544] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:25.537630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.537989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.538229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.564868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 771/1545] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:56:25.571293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.580557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:25.581870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:25.593858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71baefc-e566-43ce-95a0-2d5def2767c1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.600104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.601262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.601523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.601828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.602563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.603874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 775/1546] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:25.608113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.610762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.622227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2aea6-6f75-4e04-8565-dfae26ed6fe6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.623879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 772/1547] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:25.628895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.633530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.634527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.635040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.635540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.636492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:25.637043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.638959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.642995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0cbd3-ba91-4cdd-8082-c8ae37b149f5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.660614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 776/1548] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:56:25.667430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.668423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.668704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.668976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.673867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.676093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.686927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.695315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 773/1549] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:25.699520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.710331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166577-4525-4459-9a87-64a8e253dbe7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.714958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f1a0-42ae-463a-a14e-c6089a25cd8f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.726268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.726494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.726967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.727163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.727274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.727480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.727586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.727779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] PATH_INFO: `/v3/projects/aa2d79d2c8d941df869b69bb73ad7c87/users/0641641426b6484f9103c8410dd87762/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.728394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.730340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.752810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2d79d2c8d941df869b69bb73ad7c87, user_id=0641641426b6484f9103c8410dd87762, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.754103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:25.754103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:56:25.754103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:56:25.756243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc4eb-b2e8-4010-b72d-c997cced4887 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:25.786774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 777/1550] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:25.793426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:25.796467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 774/1551] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:25 2022] PUT /identity/v3/projects/aa2d79d2c8d941df869b69bb73ad7c87/users/0641641426b6484f9103c8410dd87762/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:25.798039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ecb4-05a4-4394-a452-bac4df035202 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.798481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ecb4-05a4-4394-a452-bac4df035202 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.798760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ecb4-05a4-4394-a452-bac4df035202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.828051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4b42ecb4-05a4-4394-a452-bac4df035202 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:25.830055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4b42ecb4-05a4-4394-a452-bac4df035202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:25.960901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9076-8f85-4d1a-9124-60fcc23daece admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:25.964226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 775/1552] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:25.965962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.966259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.966536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.978764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:25.979447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:25.979725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:25.979997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:25.980689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:25.981719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:25.981719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:56:25.981719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:56:25.982933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0cd26-510c-4a67-b878-77e2fc14419c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.024288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] MFA Rules not processed for user `0641641426b6484f9103c8410dd87762`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.025554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.035789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 778/1553] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:56:26.037308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329493-7301-4835-b2de-0bebdfaeb8f9 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.037597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329493-7301-4835-b2de-0bebdfaeb8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.037896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329493-7301-4835-b2de-0bebdfaeb8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.081335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f9329493-7301-4835-b2de-0bebdfaeb8f9 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.082570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f9329493-7301-4835-b2de-0bebdfaeb8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.091568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 779/1554] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.092843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ffca-5232-4a82-b5b2-8aa3da5059e2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.093132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ffca-5232-4a82-b5b2-8aa3da5059e2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.093412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ffca-5232-4a82-b5b2-8aa3da5059e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.120670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7899ffca-5232-4a82-b5b2-8aa3da5059e2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.120880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7899ffca-5232-4a82-b5b2-8aa3da5059e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.122848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 776/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.124290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.129782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 780/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.131105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0504c-cd8c-45b4-a3dc-9c1020fd21dc None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.131390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0504c-cd8c-45b4-a3dc-9c1020fd21dc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.131665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0504c-cd8c-45b4-a3dc-9c1020fd21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.136639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185485-a69a-4a47-91d7-a50eb9775637 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.143177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.143918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.144288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.144569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.145285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.146896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24ac6-de49-4b32-933b-5ac3472f9be9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.150245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e0f0504c-cd8c-45b4-a3dc-9c1020fd21dc None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.151421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e0f0504c-cd8c-45b4-a3dc-9c1020fd21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.156733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 777/1557] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:26.159236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.159523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.159958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.160074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 781/1558] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.161216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4074c-a90e-4dc2-8331-b473d7d9076a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.161500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4074c-a90e-4dc2-8331-b473d7d9076a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.161799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4074c-a90e-4dc2-8331-b473d7d9076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.179161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-72e4074c-a90e-4dc2-8331-b473d7d9076a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.179903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.180355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-72e4074c-a90e-4dc2-8331-b473d7d9076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.181046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.188131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 782/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.189370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.189666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.190295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 778/1560] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.190415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.191180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.207227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9c5a2-50d3-44f2-9ae4-8a670a96cd06 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.211686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.211862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.212827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.213043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.213168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.213365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.214069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.216063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d3fd5-b552-4fca-84c3-0e2302204654 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.221676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 783/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.222443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.231383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca20d0b-77a6-4d44-bd19-eddffa85bdcd None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.236279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.237206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.237898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.237898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.238783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.239200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.240802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.243622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 779/1562] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.244887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a892b6-f59c-42d1-a7b1-23cc3e87cb15 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.245173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a892b6-f59c-42d1-a7b1-23cc3e87cb15 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.245450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a892b6-f59c-42d1-a7b1-23cc3e87cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.253685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 784/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.254491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.263643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70944-ebd6-4e1f-9c0e-b17e8ef015d5 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.268425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-12a892b6-f59c-42d1-a7b1-23cc3e87cb15 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.269602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-12a892b6-f59c-42d1-a7b1-23cc3e87cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.318311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.318971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.319249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.319518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.320236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.321842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.325833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 780/1564] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.327138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beaf8d-222e-4261-9213-e8951ddadc30 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.327420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beaf8d-222e-4261-9213-e8951ddadc30 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.327692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beaf8d-222e-4261-9213-e8951ddadc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.336393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 785/1565] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:26.337379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.347797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e6b-cdf0-46c7-a549-e3f85b32661f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.351805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c0beaf8d-222e-4261-9213-e8951ddadc30 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.352334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.352977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.353094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c0beaf8d-222e-4261-9213-e8951ddadc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.353256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.353528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.354271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.354604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.356173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac34a1b-ce69-4cc0-9628-ba1ab7f4e304 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.361024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 781/1566] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.365013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.365297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.365568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.375170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 786/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.375170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.375170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.375170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.384812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.386022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.387183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.388329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.394147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 782/1568] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.397942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.399568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 787/1569] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.400171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.406717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4539-6929-4735-948a-7f7f38390c26 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.409732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636eaec-6089-4115-9ed8-2cac29bc1850 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.412262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.412902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.413177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.413441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.414141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.414302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.414926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.415205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.415528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.416012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca654c-2219-4f1c-ad1b-e45b2faf147d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.416227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.418152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.437413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 783/1570] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.439310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.439597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.439872 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.448544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 788/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.448544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.457502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.458724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.511699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85125c-4a64-4bc1-ba78-13fd7018a0ec admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.516081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 784/1572] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.516501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.517786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.518288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.518677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.519056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] PATH_INFO: `/v3/projects/3956c3f25d4e496aaef3d83857fd310f/users/d677d0933a2f4a05895b92165d857d22/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.527004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0c19-e689-494b-a7bd-cae7f6e2ef46 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.531444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.532104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.532517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.532794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.533714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.534023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.534334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3956c3f25d4e496aaef3d83857fd310f, user_id=d677d0933a2f4a05895b92165d857d22, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.535586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.536952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.547629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 785/1573] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.548447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.556379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 789/1574] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:26 2022] PUT /identity/v3/projects/3956c3f25d4e496aaef3d83857fd310f/users/d677d0933a2f4a05895b92165d857d22/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:26.557289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.558221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f373ff-18e1-457a-ad1a-556a4bcced88 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.614184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.614899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.615174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.615468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.616174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.618121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.618547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405f15-1014-453d-858c-9b3677905d2e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.623017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.623659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.623933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.624200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.624943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.625340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.627107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.638661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 790/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.639802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.649823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1be-7821-45ef-a3d3-3e2fdc3d0929 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.654047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 786/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.654047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.708338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.709118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.709470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.709777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.710507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.710814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.712230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba1fee-1b61-4de2-b3cc-f45a2290f67c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.712401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.716741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.717397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.717713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.717987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.718696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.720331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.724023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 791/1577] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.724023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.731333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 787/1578] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:26.731333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.736259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35dcce-5604-47ff-a32e-08ee91f54570 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.740853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35420b-56b9-4410-8efd-5f53d6ed973f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.741041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.741708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.741997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.742270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.742970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.744863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a77a5-a535-47e9-9659-c4662856d4a1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.745552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.746213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.746493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.746767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.747502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:26.747804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.749348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.763379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 788/1579] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:26.764173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.768561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 792/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.768561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.768561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.768561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.774519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b230f-d476-4e50-bf85-cc59095d048b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.779098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.779737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.780017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.780289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.780964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.783196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.785229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:26.786487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:26.794370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 793/1581] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:26.795219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.805575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaffe8-9929-46bc-b04c-9efd965c17fe None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.810592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.811252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.811547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.811810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.812493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.814153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 789/1582] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.814868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.818710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.847800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 794/1583] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.847800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.881208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292930-fb81-4683-9937-0525266ee4e5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.909680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71161-c764-4adb-acb8-476f31bc2f89 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:26.914345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.914994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.915271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.915540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.916218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.918145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.936362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:26.937033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:26.937333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:26.937626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:26.938303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:26.940540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:26.947854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 795/1584] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.947854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.960860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 790/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:26 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:26.961577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:26.971015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b034b-f0d0-42bf-bd21-3347ad70fa0e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.007191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00bf5-1dd8-4d88-abef-3c94ddcb3afb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.012047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.012927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.013205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.013475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] PATH_INFO: `/v3/projects/a8221a8060fe4aa689c2493750e7ce4d/users/5457a4915c8043739c60084c3e9f4185/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.025996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.026668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.026948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.027225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.027944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.028120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8221a8060fe4aa689c2493750e7ce4d, user_id=5457a4915c8043739c60084c3e9f4185, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.029530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.030769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.040540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 791/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.041461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.044574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 796/1587] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:26 2022] PUT /identity/v3/projects/a8221a8060fe4aa689c2493750e7ce4d/users/5457a4915c8043739c60084c3e9f4185/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.045359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.051528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faeb33-0765-4334-ab80-fc89dcc9b712 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.098712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4540-2b17-4bfb-9c98-d57c715ae822 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.102646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.103289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.103611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.103913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.106470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.107127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.107402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.107669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.108344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.110298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.113357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.114822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.124500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 797/1588] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:27.125541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.135535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4d16-19b9-4f08-bf2e-f1fb88a5843c service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.141017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 792/1589] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:27.141017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.217412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae41b0-0e8d-4f90-a180-c6d047288f4d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.223873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.225235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.225235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.225456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.225566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.226436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.226572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.226664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.227110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.228067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.228581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.230221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.256830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 793/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:27.256830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.268651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 798/1591] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:27.268873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5f51a-0cc0-464d-8835-0d2fee2e9195 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.268965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.273280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.274106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.274369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.274759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.275655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.278248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.284450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651c0c-b160-4b37-b048-dd3c241bdb8d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.289450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.291336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.291800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.292090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.293226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.295519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.301457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 794/1592] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:27.302237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.310070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 799/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.310870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.317149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de2cd-9ec0-4160-afe3-6b2cbb12032c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.322281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.322452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a7a8-c4c6-4d1e-90ad-364f161f449c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.323033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.323383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.323729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.324508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.326226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.327237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.327886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.328182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.328747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.329316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.330898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.338177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 795/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.339421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.345718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 800/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.345718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.352734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd9cc-49db-4efb-ba02-6ae2e0de0f04 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.355035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3da19-4e51-4236-819f-bad51a9fd72c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.357997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.359319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.359319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.359319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.360193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.361263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.362190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.362466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.362809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.363163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.363431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.365011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.384246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 801/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.384246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.395866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbeb63-fe9a-4164-8222-4fa17ee98bf2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.396597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 796/1597] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:27.397757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.404432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.405559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.405947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.406143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.406947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.409491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.410877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa1b6-f3ba-4916-bf5e-e9bcd71db2b6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.417030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.417720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.418006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.418278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.419033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.420777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.421059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 802/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.422075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.431501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 797/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.432053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.440855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062b7a-c0a9-41c6-819d-2e54f7531ca6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.443474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fd377-b596-4948-8990-d56c1479d005 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.446426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.447095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.447378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.447656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.448139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.448379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.449009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.449289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.449693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] PATH_INFO: `/v3/projects/33c19e606db245779d45fb4204bbd588/users/27f80ce1149c4f01856d53fb6ae67291/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.449998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.461274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 803/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.462133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.469232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c19e606db245779d45fb4204bbd588, user_id=27f80ce1149c4f01856d53fb6ae67291, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.472495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aee0-2aee-4282-a583-fc37b6cd0603 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.472887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.477447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.478643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.479082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.479476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] PATH_INFO: `/v3/projects/a8221a8060fe4aa689c2493750e7ce4d/users/5457a4915c8043739c60084c3e9f4185/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.482818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8221a8060fe4aa689c2493750e7ce4d, user_id=5457a4915c8043739c60084c3e9f4185, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.487395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 798/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/33c19e606db245779d45fb4204bbd588/users/27f80ce1149c4f01856d53fb6ae67291/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.488242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.489157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.514967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 804/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/a8221a8060fe4aa689c2493750e7ce4d/users/5457a4915c8043739c60084c3e9f4185/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.514967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.577826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61521-f723-49c9-acec-d1ba3ee8181f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.587256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.588168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.588614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eda21-8535-4154-b26b-dd59a9a14ddd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.588781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.589206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.590127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.591888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.593727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.594387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.594720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.595595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.596329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.597925 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.603459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 799/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.604531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.612169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 805/1604] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.615919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.616787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2c817-40c2-4321-946d-9c986c399b8c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.621675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.622366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.622648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.622925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.623645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.625281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.627030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cdf0-443c-45a3-b899-8f838cf883b8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.631871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.632564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.632823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.633090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.633833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.635438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7749-b00e-4933-b42d-ed4cdfa68dc6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.637667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 800/1605] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.642485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.646764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 806/1606] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.651220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f180-7750-4da9-aa48-53b984058ae8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.651519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f180-7750-4da9-aa48-53b984058ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.651870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f180-7750-4da9-aa48-53b984058ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.654709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f605cd-5fc8-47a9-a43a-cae02a17eae3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.660721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.661670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.661961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.662243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] PATH_INFO: `/v3/projects/a6b05c823c664dca827dff7b1ef90b31/users/a07ed5d467e742f591da7176ac0a104b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.670008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f965f180-7750-4da9-aa48-53b984058ae8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:27.671593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f965f180-7750-4da9-aa48-53b984058ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:27.678591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b05c823c664dca827dff7b1ef90b31, user_id=a07ed5d467e742f591da7176ac0a104b, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.680334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 807/1607] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:27.681403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.681639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.681783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.681971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.703271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 801/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/a6b05c823c664dca827dff7b1ef90b31/users/a07ed5d467e742f591da7176ac0a104b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.705226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.714512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] MFA Rules not processed for user `5457a4915c8043739c60084c3e9f4185`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:27.716197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:27.780760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839d553-3671-40c9-beca-6a32cc2aa760 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.788046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.789089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.789670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.789785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 808/1609] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:27.790318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.794021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] PATH_INFO: `/v3/projects/3d480e6adc214890a9f12728870993f4/users/2534bd7cd73b40b7a3bd0c0c930adaca/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.800432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a1cf-c076-474d-9e16-ae69dbea7048 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.805947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.807374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.807374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.807374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.808295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.809970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.816083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d480e6adc214890a9f12728870993f4, user_id=2534bd7cd73b40b7a3bd0c0c930adaca, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.818738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.821654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 809/1610] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:27.822557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.835045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 802/1611] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/3d480e6adc214890a9f12728870993f4/users/2534bd7cd73b40b7a3bd0c0c930adaca/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.835268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770590a2-77a1-48eb-979e-49654323f589 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.835882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.902378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.903305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.903644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.904018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] PATH_INFO: `/v3/projects/9581428b0f134e63a2b7971b8ce04ba8/users/14571f29e43e477799f5d23741307671/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.912065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72617-c5bb-4c1a-a63b-d3d66c2e9a2e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:27.917982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:27.918885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.919166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.919440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] PATH_INFO: `/v3/projects/4b1e03b7662e4cdaba4a6781dc483a86/users/ed75e7f09b1d4b60b45f7b024de32683/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:27.935031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9581428b0f134e63a2b7971b8ce04ba8, user_id=14571f29e43e477799f5d23741307671, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.943177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.943392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1e03b7662e4cdaba4a6781dc483a86, user_id=ed75e7f09b1d4b60b45f7b024de32683, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:27.946358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583c1f4-2d63-4b4b-9094-18ef23b92eaf admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:27.963620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 810/1612] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/9581428b0f134e63a2b7971b8ce04ba8/users/14571f29e43e477799f5d23741307671/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.964439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:27.964911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 803/1613] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:27 2022] PUT /identity/v3/projects/4b1e03b7662e4cdaba4a6781dc483a86/users/ed75e7f09b1d4b60b45f7b024de32683/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:27.966847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:27.967356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:27.967803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.003222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] MFA Rules not processed for user `a07ed5d467e742f591da7176ac0a104b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.005088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.038377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a357d9-fe6c-4482-b80c-f9ad6900d999 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.096731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.101358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 804/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.101482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.101482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.102044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.102170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.159652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42921-5924-4d31-aaca-c731ad8603c1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.164039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.164941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.165458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.165966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.190456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.192040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:28.207775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 811/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:28.208659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.222113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ae55-b64a-4d82-bc47-90a0990cecf3 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.232138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.233051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.233745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.233745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] PATH_INFO: `/v3/projects/10d9ed5c013644c18b9076f0af53e4ac/users/bbb56f71a17b4745b986762e5751e1fb/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.248319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.251235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac14c4c-b7eb-45f6-9cf1-8c78cbc682d6 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:28.252114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d9ed5c013644c18b9076f0af53e4ac, user_id=bbb56f71a17b4745b986762e5751e1fb, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.255060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2745ab-5836-4668-9b3b-b5c3b06ebcc8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:28.264231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 805/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:28.266146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b57b4-83b5-482c-bcf6-8e885af51e1a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.267526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b57b4-83b5-482c-bcf6-8e885af51e1a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.268048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b57b4-83b5-482c-bcf6-8e885af51e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.276366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 812/1617] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:28 2022] PUT /identity/v3/projects/10d9ed5c013644c18b9076f0af53e4ac/users/bbb56f71a17b4745b986762e5751e1fb/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:28.277930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a235c-4c21-4a4d-9592-64fc6c312d01 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.278390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a235c-4c21-4a4d-9592-64fc6c312d01 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.278671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a235c-4c21-4a4d-9592-64fc6c312d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.315467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d32a235c-4c21-4a4d-9592-64fc6c312d01 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.315781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b20b57b4-83b5-482c-bcf6-8e885af51e1a None None] MFA Rules not processed for user `2534bd7cd73b40b7a3bd0c0c930adaca`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.317218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b20b57b4-83b5-482c-bcf6-8e885af51e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.318680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d32a235c-4c21-4a4d-9592-64fc6c312d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.392831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 813/1618] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.394528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.395587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.395587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.420845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.422293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.427335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 806/1619] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.429346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c0a-0bf2-49f1-a08d-97d63fa4a576 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.429826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c0a-0bf2-49f1-a08d-97d63fa4a576 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.430105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c0a-0bf2-49f1-a08d-97d63fa4a576 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.433791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 807/1620] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:56:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:28.434456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 814/1621] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.435590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.435997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.436512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.436795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.484133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] MFA Rules not processed for user `bbb56f71a17b4745b986762e5751e1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.487451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.517196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9743dfd-3f0f-4463-8a1d-a5100a5caf39 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.522882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.523861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.524362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.525337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.580717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 808/1622] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.581508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.621589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.623325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:28.656223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 815/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:28.657842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.683134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d97d1-ce58-46ef-9780-d9560d46121e service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.698011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.698699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.698986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.699330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.699957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.701885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ce351-20b3-46e6-bb3d-aa81d1dd9c86 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:28.740792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 816/1624] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:28.742021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4617ba-aec8-470e-bfd0-7973e5f496df None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.743009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.743301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.743857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.775255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:28.777232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:28.851173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.852400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.852719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.853002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.928538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 817/1625] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:28.930453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:28.947502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0353f-7907-4725-9fd7-bce5d4ab5a16 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:28.966194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:28.966886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:28.967177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:28.967450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:28.988044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:28.989932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.010376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 809/1626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:29.011375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.021843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3494f8-6309-47a7-8de5-c0f0cb4b9fa7 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.027169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.027940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.028369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.028655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.029398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.031632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.086764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 810/1627] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:29 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:29.086764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.150343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.154574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.197283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 818/1628] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:29.199507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.247131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7dc41-cc5d-4e4d-b1c0-257f13fb07db service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.249869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01755-2c24-4b67-a5a9-1498c74b593a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.257487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.258551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.258897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.259397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.261609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.274527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.334503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 811/1629] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:29 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:29.335400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.360095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5fd1-2465-46b3-abf6-5910047d69e3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.367415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.368395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.368777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.369184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.370479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.374313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.409130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 812/1630] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:29 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:29.410130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.429003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.429003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.429303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.429457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.434359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32f22-95de-430a-b407-522c147d6942 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.440992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.441948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.442222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.443236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.444133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.446626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.468196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 813/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:29.469011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.481832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ae926-62fd-433d-adcf-ef5f60fcdac3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.489051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.489925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.490876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.491252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.492133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.494074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.508955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 814/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:29.508955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.520881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ba4e-6a0b-4d1a-b716-af4d18dcf7fc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.527574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.529025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.529783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.530283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] PATH_INFO: `/v3/projects/4211f76409f246458b5477bc12fd8c77/users/0d1712b0651d4279951ca739b4a04200/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.544165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.554928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.559686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4211f76409f246458b5477bc12fd8c77, user_id=0d1712b0651d4279951ca739b4a04200, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.564418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.572709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 819/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:29.573959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.591598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc220-d348-48d8-b2a4-df6496e3226c service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.598213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.599853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.600245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.600640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] PATH_INFO: `/v3/projects/d1bb48583ea745b79ecc739d82cc55c1/users/d6b7425549534bacbaf5bcb5e8eb5fa8/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.618193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 815/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:29 2022] PUT /identity/v3/projects/4211f76409f246458b5477bc12fd8c77/users/0d1712b0651d4279951ca739b4a04200/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:29.622535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bb48583ea745b79ecc739d82cc55c1, user_id=d6b7425549534bacbaf5bcb5e8eb5fa8, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.622730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.628331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.653456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 820/1635] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:29 2022] PUT /identity/v3/projects/d1bb48583ea745b79ecc739d82cc55c1/users/d6b7425549534bacbaf5bcb5e8eb5fa8/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:29.658961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.757327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca04422-95b8-4e38-9d96-f26db1aa303d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.766426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.768459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.769132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.772188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.773445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.774321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e621-43ae-4aec-b533-01c26883064a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.777010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.788434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.788855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.789136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.789409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.790213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.791821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.806876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 821/1636] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:56:29.810331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.825562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 816/1637] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:29.826597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:29.849117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66636f-b386-4bd8-9a3e-94c45e036144 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.858177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.859092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.861882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.862190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] PATH_INFO: `/v3/projects/d1bb48583ea745b79ecc739d82cc55c1/users/d6b7425549534bacbaf5bcb5e8eb5fa8/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.870334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bb48583ea745b79ecc739d82cc55c1, user_id=d6b7425549534bacbaf5bcb5e8eb5fa8, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.872209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fbd4e-518e-41d4-bdd1-e82761274db0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:29.873035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa796c01-d8da-40bf-9857-63a4c152ed57 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.887846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:29.890462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.893271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.893812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] PATH_INFO: `/v3/projects/4211f76409f246458b5477bc12fd8c77/users/0d1712b0651d4279951ca739b4a04200/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.909533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4211f76409f246458b5477bc12fd8c77, user_id=0d1712b0651d4279951ca739b4a04200, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:29.914691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0abedb-2f2a-4aa3-92e4-58b73ce7ea04 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:29.924365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 822/1638] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:29 2022] PUT /identity/v3/projects/d1bb48583ea745b79ecc739d82cc55c1/users/d6b7425549534bacbaf5bcb5e8eb5fa8/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:29.935520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd4f8-8559-4004-b63e-b822f3fb3151 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.936048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd4f8-8559-4004-b63e-b822f3fb3151 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.936582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd4f8-8559-4004-b63e-b822f3fb3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.960729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 817/1639] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:29 2022] PUT /identity/v3/projects/4211f76409f246458b5477bc12fd8c77/users/0d1712b0651d4279951ca739b4a04200/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:29.973472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba0bc-103d-488b-9649-9b84658057a2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:29.973834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba0bc-103d-488b-9649-9b84658057a2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:29.975644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba0bc-103d-488b-9649-9b84658057a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:29.993994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8e0fd4f8-8559-4004-b63e-b822f3fb3151 None None] MFA Rules not processed for user `d6b7425549534bacbaf5bcb5e8eb5fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:29.998756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8e0fd4f8-8559-4004-b63e-b822f3fb3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:30.070465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a62ba0bc-103d-488b-9649-9b84658057a2 None None] MFA Rules not processed for user `0d1712b0651d4279951ca739b4a04200`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:30.073637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a62ba0bc-103d-488b-9649-9b84658057a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:30.214710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 823/1640] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:30.217071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44a62-ec06-4ebd-84a1-44200c3e9591 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:30.217557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44a62-ec06-4ebd-84a1-44200c3e9591 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:30.218667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44a62-ec06-4ebd-84a1-44200c3e9591 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:30.224310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 824/1641] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 5 14:56:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:30.226709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d44a62-ec06-4ebd-84a1-44200c3e9591 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:30.278978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 818/1642] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:30.285287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:30.285721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:30.286106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:30.341416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:30.341416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:30.376740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d44a62-ec06-4ebd-84a1-44200c3e9591 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:30.381700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:30.382643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:30.383116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:30.383572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:30.402335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:30.404027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:30.431323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 825/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:30.432798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:30.443501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092227b-97cf-44a7-a92d-3133fab51eb9 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:30.457111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:30.457874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:30.458237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:30.458658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:30.484270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:30.486877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:30.500867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 826/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:30.506687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 819/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:30.552990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:30.569814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54765a7-3533-4425-9d30-f2826884605c service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:30.584445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:30.585845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:30.585992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:30.586336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:30.620319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:30.625855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edb80d-5e68-4228-b34a-3cfdab4b5f6a service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:30.661986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 827/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:31.107681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:31.124043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a2751-eda8-4d95-a335-1bce23273f82 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:31.130234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:31.131233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:31.131840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:31.132360 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:31.319441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:31.320914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82cde9-c957-4dd1-ba68-0cf3aedf03a0 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:31.378546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 820/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:32.225635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661f44-d09a-4681-bfd8-7ebcc695b615 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.226250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661f44-d09a-4681-bfd8-7ebcc695b615 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.226250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661f44-d09a-4681-bfd8-7ebcc695b615 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.227583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 828/1648] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:32.238207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1e2-fbf1-4e5d-a509-13e1af5776d8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.238559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1e2-fbf1-4e5d-a509-13e1af5776d8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.238752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1e2-fbf1-4e5d-a509-13e1af5776d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.263602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661f44-d09a-4681-bfd8-7ebcc695b615 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:32.298764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ead3b1e2-fbf1-4e5d-a509-13e1af5776d8 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:32.309279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ead3b1e2-fbf1-4e5d-a509-13e1af5776d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:32.339760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 821/1649] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:32.346430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9625-77b4-4115-bc6b-c11191d78f54 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.346715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9625-77b4-4115-bc6b-c11191d78f54 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.355593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9625-77b4-4115-bc6b-c11191d78f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.419061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cfaf9625-77b4-4115-bc6b-c11191d78f54 None None] MFA Rules not processed for user `14571f29e43e477799f5d23741307671`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:32.424305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cfaf9625-77b4-4115-bc6b-c11191d78f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:32.471832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661f44-d09a-4681-bfd8-7ebcc695b615 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:32.481040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:32.483222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.483880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.484282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] PATH_INFO: `/v3/users/bbb56f71a17b4745b986762e5751e1fb` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.487748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb56f71a17b4745b986762e5751e1fb)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:32.491950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:32.616683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 822/1650] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:32.616683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4872f7-bbbd-4fc9-9c18-151ede2e1b72 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.616683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4872f7-bbbd-4fc9-9c18-151ede2e1b72 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.616683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4872f7-bbbd-4fc9-9c18-151ede2e1b72 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.620164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 823/1651] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 5 14:56:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:32.620164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43ade-a383-4fec-a749-1b188f65a3a0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.620164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43ade-a383-4fec-a749-1b188f65a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.620164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43ade-a383-4fec-a749-1b188f65a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.630890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb56f71a17b4745b986762e5751e1fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:32.632135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb56f71a17b4745b986762e5751e1fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:32.636124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb56f71a17b4745b986762e5751e1fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:32.662204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4fa43ade-a383-4fec-a749-1b188f65a3a0 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:32.663638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4fa43ade-a383-4fec-a749-1b188f65a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:32.684842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb56f71a17b4745b986762e5751e1fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:32.691782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 824/1652] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:32.698177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd687-6aa4-4ea7-a435-12f898090c93 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.698461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd687-6aa4-4ea7-a435-12f898090c93 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.698735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd687-6aa4-4ea7-a435-12f898090c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.716264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb56f71a17b4745b986762e5751e1fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:32.736101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d11bd687-6aa4-4ea7-a435-12f898090c93 None None] MFA Rules not processed for user `14571f29e43e477799f5d23741307671`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:32.741871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d11bd687-6aa4-4ea7-a435-12f898090c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:32.743184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 829/1653] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:32 2022] DELETE /identity/v3/users/bbb56f71a17b4745b986762e5751e1fb => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:32.744913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:32.749226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:32.870313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 825/1654] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:32.871885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.873974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.874748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.888836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657b76-6790-4b91-92b7-5180ee6e7d6e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:32.900125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:32.901084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:32.901520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:32.901968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:32.910703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:32.911912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:33.050326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 826/1655] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:33.051751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:33.058630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:33.154091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:33.155548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:33.191993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 830/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:33.235234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f4ba3-ca84-415a-90cb-ce4d06274f1b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:33.252102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:33.252880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:33.253166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:33.253444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:33.261068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:33.278977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:33.280972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649208b0-054d-4b43-8733-8150c8b6a7fe service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:33.347713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 827/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:33.534787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:33.536085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:33.781343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ec46-5d01-4b49-9872-ac21cb838f03 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:33.799337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:33.800000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:33.800280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:33.800565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:33.844146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:33.847098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd8785-9f39-4286-894d-7f17e68eb1c0 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:33.896423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 831/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:34.767564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c035-599f-4d55-a2f9-377b5ce7da85 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:34.768049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c035-599f-4d55-a2f9-377b5ce7da85 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:34.768427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c035-599f-4d55-a2f9-377b5ce7da85 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:34.772009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 828/1659] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 5 14:56:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:34.788039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:34.789021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:34.789444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:34.849212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:34.850860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:34.867706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 832/1660] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:34.908860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c035-599f-4d55-a2f9-377b5ce7da85 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:34.925967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c035-599f-4d55-a2f9-377b5ce7da85 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:34.937578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:34.940701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:34.942504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:34.943024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:34.962621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:34.964102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:34.974112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:34.975555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:34.997376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f83ff-cf58-4750-a95c-7b85d8b3d6d8 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:35.005730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 829/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:35.012325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:35.013434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:35.013899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:35.014308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] PATH_INFO: `/v3/users/a07ed5d467e742f591da7176ac0a104b` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:35.018502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07ed5d467e742f591da7176ac0a104b)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:35.026321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:35.177174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:35.178490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07ed5d467e742f591da7176ac0a104b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.179288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07ed5d467e742f591da7176ac0a104b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.179983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07ed5d467e742f591da7176ac0a104b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.181979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:35.197465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07ed5d467e742f591da7176ac0a104b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.206129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e9398-9dbc-40ed-a78f-e9fa5ce9c3dc service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:35.211562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-afdac4d3-bcfd-42a6-8a0d-7c719e7f40c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07ed5d467e742f591da7176ac0a104b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.218674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:35.221076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:35.222358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:35.222775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] PATH_INFO: `/v3/users/0641641426b6484f9103c8410dd87762` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:35.226807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0641641426b6484f9103c8410dd87762)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:35.237014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:35.237014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 05 14:56:35.237014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: May 05 14:56:35.239408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 833/1662] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:34 2022] DELETE /identity/v3/users/a07ed5d467e742f591da7176ac0a104b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:56:35.240420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:35.244424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:35.245027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:35.246675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:35.272859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:35.274382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:35.449155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 834/1663] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:35.480017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0641641426b6484f9103c8410dd87762'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.480017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0641641426b6484f9103c8410dd87762'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.480791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0641641426b6484f9103c8410dd87762'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.510689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:35.514113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:35.597052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0641641426b6484f9103c8410dd87762'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.613290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f7406861-74a9-4873-a9ec-8a6e32bce19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0641641426b6484f9103c8410dd87762'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:35.650435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 830/1664] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:35 2022] DELETE /identity/v3/users/0641641426b6484f9103c8410dd87762 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:35.656426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:35.662700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:35.663237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:35.716451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a62f70-721a-44ce-ab26-60f318b20c28 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:35.718100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:35.723026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:35.853728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:35.870287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:35.871747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:35.873316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:35.882510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:35.936641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 831/1665] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:35.992560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:35.994505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:36.035401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d0e5-b689-4076-8448-9520d572eab6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:36.058820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:36.060213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:36.060703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:36.061191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:36.092131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:36.096736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:36.120892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:36.128178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:36.131248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 832/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:36.169415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 835/1667] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:37.077701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.080110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.101002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.102516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.135591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ad24-40f4-4820-8841-c54c1e5c4fc1 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:37.140412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5f74-e3e8-4738-a713-e109d7ed531d service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:37.165246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:37.166198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.166471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.166904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] PATH_INFO: `/v3/projects/aa2d79d2c8d941df869b69bb73ad7c87` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.169478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2d79d2c8d941df869b69bb73ad7c87)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:37.170838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: WARNING py.warnings [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 14:56:37.170838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: warnings.warn(msg) May 05 14:56:37.170838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: May 05 14:56:37.172039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:37.178379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:37.179270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.179558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.179833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] PATH_INFO: `/v3/projects/10d9ed5c013644c18b9076f0af53e4ac` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.184242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d9ed5c013644c18b9076f0af53e4ac)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:37.194379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:37.340417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d9ed5c013644c18b9076f0af53e4ac', 'request_id': 'req-7933ee06-4c87-4e37-9ca3-910a8cf68c61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.363682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d9ed5c013644c18b9076f0af53e4ac', 'request_id': 'req-7933ee06-4c87-4e37-9ca3-910a8cf68c61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.392412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d9ed5c013644c18b9076f0af53e4ac', 'request_id': 'req-7933ee06-4c87-4e37-9ca3-910a8cf68c61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.417783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2d79d2c8d941df869b69bb73ad7c87', 'request_id': 'req-ac17cd87-485d-45c8-9449-12f35742b584'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.429459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] The token cache is being invalidate because project 10d9ed5c013644c18b9076f0af53e4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:37.429837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.436110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7933ee06-4c87-4e37-9ca3-910a8cf68c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.443370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2d79d2c8d941df869b69bb73ad7c87', 'request_id': 'req-ac17cd87-485d-45c8-9449-12f35742b584'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.444683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:37 2022] DELETE /identity/v3/projects/10d9ed5c013644c18b9076f0af53e4ac => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:37.446754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.448793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.449223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.450992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 834/1669] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 5 14:56:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:37.464571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.470710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.487446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2d79d2c8d941df869b69bb73ad7c87', 'request_id': 'req-ac17cd87-485d-45c8-9449-12f35742b584'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.513522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] The token cache is being invalidate because project aa2d79d2c8d941df869b69bb73ad7c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:37.513845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.516825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ac17cd87-485d-45c8-9449-12f35742b584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.528876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 836/1670] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:37 2022] DELETE /identity/v3/projects/aa2d79d2c8d941df869b69bb73ad7c87 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:37.530872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.531164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.531448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.568761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] MFA Rules not processed for user `738c11c19b03412d95720428d76d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:37.570232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.635156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bdbac-f78e-4786-b9cf-239f66389116 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:37.645037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:37.646222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.646636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.647041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] PATH_INFO: `/v3/users/d6b7425549534bacbaf5bcb5e8eb5fa8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.648452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b7425549534bacbaf5bcb5e8eb5fa8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:37.650548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:37.704080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 837/1671] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 5 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:37.706586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.708890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.713580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b7425549534bacbaf5bcb5e8eb5fa8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.714342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b7425549534bacbaf5bcb5e8eb5fa8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.714950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b7425549534bacbaf5bcb5e8eb5fa8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.731458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b869-e459-41c9-804d-5dd5c62170a0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:37.739641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b7425549534bacbaf5bcb5e8eb5fa8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.739975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:37.741605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.742229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.742812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] PATH_INFO: `/v3/users/5457a4915c8043739c60084c3e9f4185` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.744395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5457a4915c8043739c60084c3e9f4185)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:37.747815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:37.751233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b7425549534bacbaf5bcb5e8eb5fa8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.775829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 835/1672] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:37 2022] DELETE /identity/v3/users/d6b7425549534bacbaf5bcb5e8eb5fa8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:37.776676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.779929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.854905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5457a4915c8043739c60084c3e9f4185'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.856029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5457a4915c8043739c60084c3e9f4185'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.857097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5457a4915c8043739c60084c3e9f4185'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.879803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc227d6-1c79-4ec8-8152-1773a83583ba admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:37.881371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5457a4915c8043739c60084c3e9f4185'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.892890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5457a4915c8043739c60084c3e9f4185'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:37.899961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:37.901390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:37.902090 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:37.903011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:37.909564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:37.934742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 838/1673] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:37 2022] DELETE /identity/v3/users/5457a4915c8043739c60084c3e9f4185 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:37.942371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:37.944908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aca22-dd52-4ca3-8313-482144cefcc3 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:37.960587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 836/1674] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:37.996893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:37.998948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.112406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252373c3-cc25-4632-9404-1d2059a2cdd4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.112915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252373c3-cc25-4632-9404-1d2059a2cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.112997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252373c3-cc25-4632-9404-1d2059a2cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.151127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc689ac-00b9-4798-89a7-8d7e603d2597 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:38.157957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:38.159466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.159956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.160530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] PATH_INFO: `/v3/projects/a6b05c823c664dca827dff7b1ef90b31` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.163771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b05c823c664dca827dff7b1ef90b31)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:38.166326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:38.201920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-252373c3-cc25-4632-9404-1d2059a2cdd4 None None] MFA Rules not processed for user `d677d0933a2f4a05895b92165d857d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:38.204273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-252373c3-cc25-4632-9404-1d2059a2cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.303974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b05c823c664dca827dff7b1ef90b31', 'request_id': 'req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:38.312581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b05c823c664dca827dff7b1ef90b31', 'request_id': 'req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:38.322365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b05c823c664dca827dff7b1ef90b31', 'request_id': 'req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:38.355053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] The token cache is being invalidate because project a6b05c823c664dca827dff7b1ef90b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:38.356842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:38.359301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c6bcdbb1-4f96-4c57-8db3-6f411385dbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:38.368589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 839/1675] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:37 2022] DELETE /identity/v3/projects/a6b05c823c664dca827dff7b1ef90b31 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:38.372239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb641-936d-4508-902f-f0c72d3577e0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.374615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb641-936d-4508-902f-f0c72d3577e0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.375211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb641-936d-4508-902f-f0c72d3577e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.419085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 837/1676] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:38.420158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d93fb641-936d-4508-902f-f0c72d3577e0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:38.421450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d93fb641-936d-4508-902f-f0c72d3577e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.431619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.432139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.432575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.488415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] MFA Rules not processed for user `d677d0933a2f4a05895b92165d857d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:38.489756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.618144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 838/1677] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:38.630135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:38.631845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.674986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 840/1678] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:38.683185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c670-024d-45eb-beb0-9df770546778 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.689791 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c670-024d-45eb-beb0-9df770546778 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.694027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c670-024d-45eb-beb0-9df770546778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.787003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2393c670-024d-45eb-beb0-9df770546778 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:38.789404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2ea74-08f4-442e-9722-9e1a96df46df None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:38.795763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2393c670-024d-45eb-beb0-9df770546778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:38.808655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:38.809333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.809610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.809910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.826881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:38.829075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:38.849909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 841/1679] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:38.854523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c670-024d-45eb-beb0-9df770546778 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:38.868171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 839/1680] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:56:38.887158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c670-024d-45eb-beb0-9df770546778 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:38.902723 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:38.903726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.904143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.904583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.905501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:38.905965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:38.912909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:38.941996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 842/1681] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:56:38.946253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:38.963703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164fbf-70e2-4b27-99f3-f6b2fdb12ad7 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:38.975751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:38.976641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:38.977326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:38.977875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:38.978893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:38.981080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.063684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.071347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:39.073220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 840/1682] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:38 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:39.077420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.097343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b0bc-eda0-4cee-b48a-359aa85169d6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.200518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.202873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.204469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.204957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] PATH_INFO: `/v3/projects/d1bb48583ea745b79ecc739d82cc55c1` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.209326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bb48583ea745b79ecc739d82cc55c1)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.214300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.214692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f51ad-b795-4f1f-a14f-00c9bccef674 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.232838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.233538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.233843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.234166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.234914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.241512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.298358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 841/1683] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:39 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:56:39.304797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.327055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bb48583ea745b79ecc739d82cc55c1', 'request_id': 'req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:39.338095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ec49-42ba-4414-b619-570277e9c6f9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.343192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bb48583ea745b79ecc739d82cc55c1', 'request_id': 'req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:39.357509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bb48583ea745b79ecc739d82cc55c1', 'request_id': 'req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:39.387024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] The token cache is being invalidate because project d1bb48583ea745b79ecc739d82cc55c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:39.387361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:39.388841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fa7cf322-4919-4f34-9ce6-fe1be5f50b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:39.392003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 843/1684] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:39 2022] DELETE /identity/v3/projects/d1bb48583ea745b79ecc739d82cc55c1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:56:39.398188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca749d6-fb43-4906-aacd-f2d546f618fb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.398472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca749d6-fb43-4906-aacd-f2d546f618fb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.398750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca749d6-fb43-4906-aacd-f2d546f618fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.448627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4ca749d6-fb43-4906-aacd-f2d546f618fb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:39.449877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4ca749d6-fb43-4906-aacd-f2d546f618fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:39.487460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.488158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.489384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.491072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.491863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.496185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.522493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 842/1685] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:39.528144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.531282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:39.585234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62bf2-6c6f-4bca-bf66-5deb02fd5840 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.593765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 844/1686] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:39.600902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.601148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.601539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.607883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.608601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.608890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.609220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.610123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.616660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.635355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 843/1687] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:39.639587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.642806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:39.644020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:39.663775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aa11-fd65-4f5f-9aac-a49f1cbedd30 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.669307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 845/1688] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:39.674179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.678614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.681177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.681467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.681829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] PATH_INFO: `/v3/projects/5e033249dd384b91b78ee28097fa201d/users/cc2b6c0206434dee837175514cd7982d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.695677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ee327-5340-4e77-9240-c1fd1d58d9eb None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.709240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.710274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.710555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.710980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.711878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:39.712192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.714015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.716519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e033249dd384b91b78ee28097fa201d, user_id=cc2b6c0206434dee837175514cd7982d, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:39.720751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:39.751636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 846/1689] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:56:39.751636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.758842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:39.760308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 844/1690] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:39 2022] PUT /identity/v3/projects/5e033249dd384b91b78ee28097fa201d/users/cc2b6c0206434dee837175514cd7982d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:39.761160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:39.791127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a480d-499d-4cd2-bda7-75a62fa093cb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.974065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a544c-e7fe-4445-a301-dd4eaba4dca7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:39.989188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:39.989907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:39.990151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:39.990421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:39.991112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.004071 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56d02-1996-497c-967c-28b792a8affb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.021596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.022556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.022965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.023246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] PATH_INFO: `/v3/projects/a8221a8060fe4aa689c2493750e7ce4d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.036252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8221a8060fe4aa689c2493750e7ce4d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.039111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.104209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 845/1691] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:39 2022] POST /identity/v3/projects => generated 385 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:40.107361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bfd07-29cc-4f75-8fe9-ed16445c512d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.107587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bfd07-29cc-4f75-8fe9-ed16445c512d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.107867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bfd07-29cc-4f75-8fe9-ed16445c512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.198009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8221a8060fe4aa689c2493750e7ce4d', 'request_id': 'req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:40.207393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8221a8060fe4aa689c2493750e7ce4d', 'request_id': 'req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:40.213799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7e8bfd07-29cc-4f75-8fe9-ed16445c512d None None] MFA Rules not processed for user `cc2b6c0206434dee837175514cd7982d`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:40.214956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7e8bfd07-29cc-4f75-8fe9-ed16445c512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.216951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8221a8060fe4aa689c2493750e7ce4d', 'request_id': 'req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:40.250076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] The token cache is being invalidate because project a8221a8060fe4aa689c2493750e7ce4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:40.251081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:40.252376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:40.261893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 847/1692] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:39 2022] DELETE /identity/v3/projects/a8221a8060fe4aa689c2493750e7ce4d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:40.264485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:40.269246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.467259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 846/1693] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:40.468600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bea6f-6006-41d2-8f9b-3c5c524c5d1c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.468885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bea6f-6006-41d2-8f9b-3c5c524c5d1c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.469790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bea6f-6006-41d2-8f9b-3c5c524c5d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.485373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1309b5-82f0-4ff6-85fa-ad2be7da67fe admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:40.500032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.503167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.503719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.504849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.506905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.513252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.545555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1e1bea6f-6006-41d2-8f9b-3c5c524c5d1c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:40.546838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1e1bea6f-6006-41d2-8f9b-3c5c524c5d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.571269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 847/1694] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:40.580147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.580147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.580147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.604448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 848/1695] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:40 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:40.609521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:40.618859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:40.620055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.644761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2def-9288-444a-bcda-b6178ef45960 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:40.660755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.661431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.661738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.662009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.662739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.664322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ce21-4c64-43ac-9238-5823488ef108 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.667516 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 848/1696] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:40.668564 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:40.670058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.717248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 849/1697] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:40.718632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.718919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.719244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.788601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] MFA Rules not processed for user `d677d0933a2f4a05895b92165d857d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:40.796310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:40.872161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78be9c-8b2e-4e94-bf50-c8c7a475fafe None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:40.889835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.890804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.891294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.891696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.915905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.919982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.937100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 850/1698] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:40.938703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:40.940460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 849/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:40.942575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:40.962330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24efc77-fc2b-4872-a153-80dd2da0457f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:40.976207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b06f-2734-4be1-bd39-aa6a913b8957 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:40.976882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.977558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.977865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.978170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.978957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:40.979267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.983361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:40.988395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:40.989240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:40.989522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:40.989834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:40.990871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:40.992632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616bd8d-a699-4b9b-b589-3fdb7cf12bad admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:41.006469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 850/1700] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:41.008107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf14c-b371-4529-a0ff-0ecc05011c14 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.008475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf14c-b371-4529-a0ff-0ecc05011c14 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.008764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf14c-b371-4529-a0ff-0ecc05011c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.034018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 851/1701] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:41.038704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:41.044268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-681bf14c-b371-4529-a0ff-0ecc05011c14 None None] MFA Rules not processed for user `27f80ce1149c4f01856d53fb6ae67291`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:41.046344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-681bf14c-b371-4529-a0ff-0ecc05011c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:41.084280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9a0-297b-4560-b84c-3c11e2170555 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:41.097152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:41.098210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.098762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.098877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] PATH_INFO: `/v3/projects/60a239803335412e94e644dcee2f09b0/users/b6999c37ff63459fb9c1370358382e4f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.142940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a239803335412e94e644dcee2f09b0, user_id=b6999c37ff63459fb9c1370358382e4f, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:41.150778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:41.191455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 852/1702] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:41 2022] PUT /identity/v3/projects/60a239803335412e94e644dcee2f09b0/users/b6999c37ff63459fb9c1370358382e4f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:41.192341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:41.318168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 851/1703] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:41.319978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.320425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.320938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.382034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465cac-808b-46a2-8165-3fb748208a9e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:41.383207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] MFA Rules not processed for user `b6999c37ff63459fb9c1370358382e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:41.384413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:41.393286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:41.394514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.394712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.395097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.396255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:41.404869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:41.466814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 853/1704] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:41 2022] POST /identity/v3/projects => generated 391 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:41.467772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:41.472811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:41.566888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 852/1705] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:41.569475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:41.627487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c7ca-eb02-4291-ade5-7c2176fc161e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:41.634892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:41.635790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.636342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.637386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] PATH_INFO: `/v3/users/cc2b6c0206434dee837175514cd7982d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.640474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2b6c0206434dee837175514cd7982d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:41.644111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:41.743667 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2b6c0206434dee837175514cd7982d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:41.744814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2b6c0206434dee837175514cd7982d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:41.747030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2b6c0206434dee837175514cd7982d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:41.751330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0b317-2473-45d9-9513-41dc2342c370 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:41.773763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2b6c0206434dee837175514cd7982d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:41.799195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2b6c0206434dee837175514cd7982d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:41.821207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 854/1706] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:41 2022] DELETE /identity/v3/users/cc2b6c0206434dee837175514cd7982d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:41.823575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:41.871905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:41.963096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:41.963774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:41.964056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:41.967706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:41.970595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.032582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9613-decd-47d5-a031-2b017127bdb8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.051382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.052074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.052356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.052631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.053443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.055724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74023ff-dc83-47b5-aa08-0bf9a583f661 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.111172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 855/1707] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:41 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:42.112582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.112874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.113153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.151163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.152949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.170458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:42.174400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.177803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 853/1708] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:42.178760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.185408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.211705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa942a2-b2c6-4164-915f-057fdb2cd0ed service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.234497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.235325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.235709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.235986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.236679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.238737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be37d5-4e11-4837-b5cc-cb0ea4725a59 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.290561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 854/1709] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:42 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:42.292086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40e16-d2f9-4a39-9f1d-8065efae17ed None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.292369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40e16-d2f9-4a39-9f1d-8065efae17ed None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.292674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d40e16-d2f9-4a39-9f1d-8065efae17ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.349777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-63d40e16-d2f9-4a39-9f1d-8065efae17ed None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:42.350987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-63d40e16-d2f9-4a39-9f1d-8065efae17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.356238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 856/1710] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:42.357192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.392469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b0dde-441b-49ad-a47b-8ece5c743e8d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.502156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 855/1711] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:42.502156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84dd5-6418-4860-b600-05ba0bbcd644 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.502156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84dd5-6418-4860-b600-05ba0bbcd644 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.502156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84dd5-6418-4860-b600-05ba0bbcd644 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.503460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 856/1712] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 5 14:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:56:42.507545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f84dd5-6418-4860-b600-05ba0bbcd644 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.559457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f84dd5-6418-4860-b600-05ba0bbcd644 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.576819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.577594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.577905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.578181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.579553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.581122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0981-2ae9-4aef-b05a-4cc67a70cfd7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.619381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.620170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.620457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.620765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.630455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.632443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.642711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 857/1713] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:42 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:42.645997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.646307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.647770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.690376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 857/1714] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:42.691413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.700476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.706454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:42.713885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.835231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c49bd-90d6-4c2f-9a4a-ce008a8392bf admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.849070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.849612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.850104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.850275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.869206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.870682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:42.887559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 858/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:42.888481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.890097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:42.901478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 858/1716] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:42.909838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:42.960517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f072-1fa3-4007-a356-04c7cb8fe20c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:42.988386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:42.988804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:42.989561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:42.989859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:42.990670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:42.992555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.041568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 859/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:43.063055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:43.098509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c2480-beaf-4d6e-a7d0-ea8560b45ad5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:43.146182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:43.151400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.163538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.165724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.168077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:43.172514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.182748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bdcdd-a531-48b6-9393-a5dae0eff8c6 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:43.207014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:43.210105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.210991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.212038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.229602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 860/1718] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:43.235188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:43.237837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:43.278072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996611-163d-42e2-8508-0115d4d68be6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:43.292390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:43.293351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.293972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.297211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.323465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:43.327567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.362688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 861/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:43.364877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:43.399508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1b4-0ea0-419b-921e-155a46e37363 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:43.409947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:43.413315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:43.414496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.417529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.418077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.419341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] PATH_INFO: `/v3/projects/7eb1dedd957740f4a232fb094aac2df8/users/44d5e9ebad654a718827c0bd94bb5650/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.446501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 859/1720] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:56:43.447602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:43.464745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9043cb-6c5d-494a-9c3c-8e299b987f38 service swift] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:43.500865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb1dedd957740f4a232fb094aac2df8, user_id=44d5e9ebad654a718827c0bd94bb5650, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:43.508743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.513359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:43.514311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.514595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.520721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] PATH_INFO: `/v3/projects/a44ef8c8eeeb4cd2bfb89e68be075b1c/users/c5c5f8834e5d4f12ae0dc45642403741/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.546896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 862/1721] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:43 2022] PUT /identity/v3/projects/7eb1dedd957740f4a232fb094aac2df8/users/44d5e9ebad654a718827c0bd94bb5650/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:43.551226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:43.598684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44ef8c8eeeb4cd2bfb89e68be075b1c, user_id=c5c5f8834e5d4f12ae0dc45642403741, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:43.607326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416155b2-322a-4845-adc1-7986fb6511b7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:43.679592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 860/1722] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:43 2022] PUT /identity/v3/projects/a44ef8c8eeeb4cd2bfb89e68be075b1c/users/c5c5f8834e5d4f12ae0dc45642403741/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:43.683447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:43.683735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:43.690409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:43.831873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] MFA Rules not processed for user `c5c5f8834e5d4f12ae0dc45642403741`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:43.833122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:43.850555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea279f-8278-42c6-a0e5-f218c2698d27 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.056032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:44.056719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.056997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.057271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.058043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:44.059685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:44.078563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 861/1723] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:44.080423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:44.082600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:44.098826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 863/1724] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:44.098826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:44.124581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36592819-5eb0-4b40-b3a6-1ce6a5302bc3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.140246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaca43-4c34-40fc-a34d-b6bfeaaf4db9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.145485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:44.147818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.148113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.148398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] PATH_INFO: `/v3/users/2534bd7cd73b40b7a3bd0c0c930adaca` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.154974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2534bd7cd73b40b7a3bd0c0c930adaca)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:44.156993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:44.161072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:44.161939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.162277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.162560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.164735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:44.165578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:44.281281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 864/1725] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:44 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:44.294544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:44.386081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2534bd7cd73b40b7a3bd0c0c930adaca'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:44.388403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2534bd7cd73b40b7a3bd0c0c930adaca'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:44.390651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2534bd7cd73b40b7a3bd0c0c930adaca'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:44.453610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2534bd7cd73b40b7a3bd0c0c930adaca'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:44.475684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2534bd7cd73b40b7a3bd0c0c930adaca'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:44.509118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 862/1726] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:44 2022] DELETE /identity/v3/users/2534bd7cd73b40b7a3bd0c0c930adaca => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:44.510149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:44.512995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:44.584300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a2aa-18a5-410e-8a1f-6a6706c9c270 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.762375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fac8-0e2a-49e8-8102-9c74fd7143c1 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.795630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:44.797458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.798081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.798400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.799125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:44.810769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa031b-6d4a-4a13-9a16-b5aa9bca5626 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:44.862533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 863/1727] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:44 2022] POST /identity/v3/users => generated 303 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:44.869233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.869518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.869842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.925712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:44.926936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:44.952908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 864/1728] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:44.954404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:44.956356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:44.978737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:44.979653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:44.979933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:44.980211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] PATH_INFO: `/v3/projects/7eb1dedd957740f4a232fb094aac2df8/users/44d5e9ebad654a718827c0bd94bb5650/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:44.987757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb1dedd957740f4a232fb094aac2df8, user_id=44d5e9ebad654a718827c0bd94bb5650, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:44.990771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a95d-f957-4612-a5e8-6c37475e4a0b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:44.999874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:45.009815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:45.010694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.010979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.011250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] PATH_INFO: `/v3/projects/5e033249dd384b91b78ee28097fa201d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.013863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e033249dd384b91b78ee28097fa201d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:45.015939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:45.041608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 865/1729] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:44 2022] PUT /identity/v3/projects/7eb1dedd957740f4a232fb094aac2df8/users/44d5e9ebad654a718827c0bd94bb5650/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:45.047232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:45.223312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e033249dd384b91b78ee28097fa201d', 'request_id': 'req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:45.246178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e033249dd384b91b78ee28097fa201d', 'request_id': 'req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:45.263750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0c72-9a14-41cd-ad99-5f86c890106f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:45.282805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e033249dd384b91b78ee28097fa201d', 'request_id': 'req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:45.331228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] The token cache is being invalidate because project 5e033249dd384b91b78ee28097fa201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:45.334038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:45.336314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:45.346655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 865/1730] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:44 2022] DELETE /identity/v3/projects/5e033249dd384b91b78ee28097fa201d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:45.346655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:45.348223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.379254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:45.380484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.381442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.382613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.383605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:45.385759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80442cf4-3f13-4c2f-9258-815d371931b4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:45.400890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 866/1731] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:45.402989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45411d-7168-47ef-83a9-3f88be2ba640 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.403421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45411d-7168-47ef-83a9-3f88be2ba640 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.404101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45411d-7168-47ef-83a9-3f88be2ba640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.524609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1d45411d-7168-47ef-83a9-3f88be2ba640 None None] MFA Rules not processed for user `44d5e9ebad654a718827c0bd94bb5650`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:45.531791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1d45411d-7168-47ef-83a9-3f88be2ba640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.543804 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f26fb-0fa5-44d3-bc21-ac11d8b9f276 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:45.557223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:45.558488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.559861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.561353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.568694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.602743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:45.606457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98cbf9-1e14-4701-b397-62d040d43627 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:45.651139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 866/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:45.653226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.653739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.656379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.713828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:45.716019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.741487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 867/1733] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:45.744916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:45.747035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.770317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 867/1734] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:45.776219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.776722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.777905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.787701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bb430-59ea-43cb-8094-3f72b95236b3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:45.804832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:45.806171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:45.806692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:45.807071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] PATH_INFO: `/v3/projects/1fa290a928cb4f2aa202a6413d9a9274/users/36d25bc0422641db88cbb4878fe35e57/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:45.865304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:45.870173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.897294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa290a928cb4f2aa202a6413d9a9274, user_id=36d25bc0422641db88cbb4878fe35e57, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:45.908499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:45.920747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 868/1735] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:45.923404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:45.930029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:45.959239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 868/1736] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:45 2022] PUT /identity/v3/projects/1fa290a928cb4f2aa202a6413d9a9274/users/36d25bc0422641db88cbb4878fe35e57/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:45.962628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.147642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6329c9e-609e-4a0d-80d3-70e171d2a0c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.232111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3796b-d17b-4ea2-bec8-319917385d36 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.253353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.256838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.258360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.259399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.265248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:46.266412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.268384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.320084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 869/1737] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:46.321226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.346316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.349613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.353479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.354289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.354415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976927d2-15a2-48dd-8701-521724f48932 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.370603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.373552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.373902 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.374255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.375005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.378338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.405781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 870/1738] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:46.408360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.432469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873199-90fa-45d5-908f-780ccf0b60f4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.445525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.446283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.446565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.446835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.449328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.451778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.513127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 871/1739] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:46 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:46.513420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.576675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.579317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.604206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 869/1740] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:46.605690 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.631139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650861d-f0af-43ac-b0aa-7f16062c55cd service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.691259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20aa9e-f79d-4ee9-8584-bbf08baa5a9f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:46.701344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.702291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.702571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.702955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] PATH_INFO: `/v3/projects/1fa290a928cb4f2aa202a6413d9a9274/users/36d25bc0422641db88cbb4878fe35e57/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.710382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa290a928cb4f2aa202a6413d9a9274, user_id=36d25bc0422641db88cbb4878fe35e57, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.714239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d764e99-b7a7-473f-9b92-365927b34436 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.754772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 872/1741] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:46 2022] PUT /identity/v3/projects/1fa290a928cb4f2aa202a6413d9a9274/users/36d25bc0422641db88cbb4878fe35e57/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:46.759297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.759584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.760394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.828923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:46.831283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:46.832366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:46.832764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:46.835387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:46.844323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:46.868689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] MFA Rules not processed for user `36d25bc0422641db88cbb4878fe35e57`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:46.892519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:46.961810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 870/1742] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:46 2022] POST /identity/v3/users => generated 287 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:46.963758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:46.974399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:47.011969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024070f1-32d0-4a60-af6f-f4de9873e46c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.151269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 873/1743] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:47.152732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.159924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:47.164520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.164827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.168087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] PATH_INFO: `/v3/users/b6999c37ff63459fb9c1370358382e4f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.176331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6999c37ff63459fb9c1370358382e4f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:47.181875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:47.186325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599f8c-3088-4342-a252-70812aba3ffc None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.202680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:47.203508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.203862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.204227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.205038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:47.208516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:47.233581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 874/1744] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:47.238189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.346104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6999c37ff63459fb9c1370358382e4f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:47.365576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6999c37ff63459fb9c1370358382e4f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:47.368257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6999c37ff63459fb9c1370358382e4f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:47.395106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef97082-61fd-463f-9766-3e1f3a48cb64 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.400367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:47.401045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.401330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.401605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.411907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:47.415776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6999c37ff63459fb9c1370358382e4f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:47.436167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:47.437730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501875-6d03-4229-bbac-a88faf469291 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:47.440739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6999c37ff63459fb9c1370358382e4f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:47.475602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 871/1745] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:46 2022] DELETE /identity/v3/users/b6999c37ff63459fb9c1370358382e4f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:47.475602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.478746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:47.485135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 875/1746] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:47.499875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.500265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.500558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.586225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:47.587464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:47.679215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e956bd-0a99-4a47-8b34-e7f056ef7014 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.707462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:47.709703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.709990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.710270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.711113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:47.722597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:47.766299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:47.767358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.781046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:47.817311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 876/1748] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:47.817311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.843637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a9fa1-72c6-4eeb-8ad6-9efcc0b378db None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.863061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:47.864069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:47.864354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:47.864702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] PATH_INFO: `/v3/projects/c91e32f603f14660aea46cfc9a11a5ad/users/8171daaaafe74dac982435762d152bf3/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:47.912878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91e32f603f14660aea46cfc9a11a5ad, user_id=8171daaaafe74dac982435762d152bf3, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:47.919504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:47.954104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 877/1749] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:47 2022] PUT /identity/v3/projects/c91e32f603f14660aea46cfc9a11a5ad/users/8171daaaafe74dac982435762d152bf3/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:47.954851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:47.959033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c8dc-19cd-4593-9eab-c39bb54e293c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:47.978607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:48.112362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:48.113144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:48.113496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:48.113881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:48.118907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:48.189096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03401-c387-44ab-94d9-eb0ea7095946 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:48.206695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:48.207855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:48.208282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:48.208881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] PATH_INFO: `/v3/projects/3d480e6adc214890a9f12728870993f4` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:48.213766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d480e6adc214890a9f12728870993f4)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:48.216982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:48.365520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:48.371554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:48.384965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d480e6adc214890a9f12728870993f4', 'request_id': 'req-44d6bfd1-9cc9-4da1-9272-275480bb79a3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:48.416002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 873/1750] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:48.423984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:48.430884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:48.431647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d480e6adc214890a9f12728870993f4', 'request_id': 'req-44d6bfd1-9cc9-4da1-9272-275480bb79a3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:48.478850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d480e6adc214890a9f12728870993f4', 'request_id': 'req-44d6bfd1-9cc9-4da1-9272-275480bb79a3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:48.542677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] The token cache is being invalidate because project 3d480e6adc214890a9f12728870993f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:48.543065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:48.547646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-44d6bfd1-9cc9-4da1-9272-275480bb79a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:48.560184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 878/1751] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:47 2022] DELETE /identity/v3/projects/3d480e6adc214890a9f12728870993f4 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:48.561736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:48.570492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:48.570637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:48.691204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:48.693032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:48.856909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a364-5de5-4754-817a-89e6b9990430 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:49.088113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 879/1752] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:49.089508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:49.091182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:49.091734 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:49.091932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:49.092374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:49.092374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:49.101830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:49.145004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075f58f-e76e-4288-b23e-6cfe99a01e28 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:49.170096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:49.170994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:49.171276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:49.171551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] PATH_INFO: `/v3/users/0d1712b0651d4279951ca739b4a04200` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:49.174491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1712b0651d4279951ca739b4a04200)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:49.176890 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:49.184956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:49.191012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0440dc-babf-4c9c-9c7c-62908f68ec66 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:49.226112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 874/1753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:49.230415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:49.231999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:49.233089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:49.291847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] MFA Rules not processed for user `27f80ce1149c4f01856d53fb6ae67291`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:49.293244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:49.569389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 875/1754] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:49.580259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:49.590683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:49.628234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f1951-7298-4ece-a66c-dcd4e6a27085 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:49.648124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:49.649793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:49.650086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:49.650370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:49.686616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:49.691839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557b772-fadf-49ff-a34e-626496c8ebc0 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:49.734140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 876/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:49.740007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ca72-9609-4906-b1ea-c33f3a70f1f6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:49.740336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ca72-9609-4906-b1ea-c33f3a70f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:49.740574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ca72-9609-4906-b1ea-c33f3a70f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:49.862064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7267ca72-9609-4906-b1ea-c33f3a70f1f6 None None] MFA Rules not processed for user `ed75e7f09b1d4b60b45f7b024de32683`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:49.863414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7267ca72-9609-4906-b1ea-c33f3a70f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:49.992700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1712b0651d4279951ca739b4a04200'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:49.993402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1712b0651d4279951ca739b4a04200'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:49.994145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1712b0651d4279951ca739b4a04200'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:50.019886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1712b0651d4279951ca739b4a04200'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:50.059258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1712b0651d4279951ca739b4a04200'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:50.102771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 880/1756] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:49 2022] DELETE /identity/v3/users/0d1712b0651d4279951ca739b4a04200 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:50.136718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 877/1757] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:50.413370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:50.415095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:50.566673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23347d-72ad-4b46-b303-3ee3dc2ac7e0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:50.583987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:50.584662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:50.588871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:50.589207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:50.802819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:50.811025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:50.854252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 881/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:51.100275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:51.101084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:51.101426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:51.164328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:51.165715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:51.387399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 878/1759] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 5 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:51.717307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:51.719752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:51.756923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4cb4c-55ee-402f-b81e-22350ff013fa service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:51.779233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:51.781663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:51.782141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:51.784364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:51.846151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:51.847776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:51.873018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 882/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:52.089989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:52.091794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:52.214480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222fc3-254b-4f2d-a669-5ce486077e06 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:52.231810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:52.233037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:52.233502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:52.233987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] PATH_INFO: `/v3/projects/4211f76409f246458b5477bc12fd8c77` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:52.236069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4211f76409f246458b5477bc12fd8c77)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:52.238219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:52.294102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:52.296417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:52.359996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7f3f-9cc0-4305-88fa-b712dee0f673 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:52.377994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4211f76409f246458b5477bc12fd8c77', 'request_id': 'req-62b2fb15-81b7-4458-aff4-812c3d2c91ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.386821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4211f76409f246458b5477bc12fd8c77', 'request_id': 'req-62b2fb15-81b7-4458-aff4-812c3d2c91ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.399587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4211f76409f246458b5477bc12fd8c77', 'request_id': 'req-62b2fb15-81b7-4458-aff4-812c3d2c91ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.434909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] The token cache is being invalidate because project 4211f76409f246458b5477bc12fd8c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:52.435259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.442609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-62b2fb15-81b7-4458-aff4-812c3d2c91ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.449316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 879/1761] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:52 2022] DELETE /identity/v3/projects/4211f76409f246458b5477bc12fd8c77 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:52.450735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:52.451060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:52.451334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:52.582415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] MFA Rules not processed for user `8171daaaafe74dac982435762d152bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:52.583867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:52.614370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:52.615628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:52.620103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:52.620495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] PATH_INFO: `/v3/projects/60a239803335412e94e644dcee2f09b0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:52.636707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a239803335412e94e644dcee2f09b0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:52.638935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:52.796482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a239803335412e94e644dcee2f09b0', 'request_id': 'req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.811005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a239803335412e94e644dcee2f09b0', 'request_id': 'req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.829155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a239803335412e94e644dcee2f09b0', 'request_id': 'req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.862517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] The token cache is being invalidate because project 60a239803335412e94e644dcee2f09b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:52.862929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.864567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6d32cb16-8d2a-4f59-a0f8-d95af84538f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:52.886562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 883/1762] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:52 2022] DELETE /identity/v3/projects/60a239803335412e94e644dcee2f09b0 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:52.887653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 880/1763] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:52.888538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:52.889068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:52.889579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:52.890093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:52.897539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:52.917978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:52.919563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:52.942105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce968f-97d0-46ed-9669-f6af91058676 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.084874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 884/1764] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:53.086174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.087911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:53.153947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cce1e9-cb65-4279-86ba-7da3096159f4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.162350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.164095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.164691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.165189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.166457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.169535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e6eae-b277-421b-931b-26557c1cbe49 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.203458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.205867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.208070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.208521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] PATH_INFO: `/v3/users/44d5e9ebad654a718827c0bd94bb5650` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.214574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d5e9ebad654a718827c0bd94bb5650)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.220332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.226379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 885/1765] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:53 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:53.228030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.230807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.231378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.298033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:53.299416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:53.361304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d5e9ebad654a718827c0bd94bb5650'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:53.363100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d5e9ebad654a718827c0bd94bb5650'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:53.366676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d5e9ebad654a718827c0bd94bb5650'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:53.410325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d5e9ebad654a718827c0bd94bb5650'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:53.431443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d5e9ebad654a718827c0bd94bb5650'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:53.466778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 881/1766] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:52 2022] DELETE /identity/v3/users/44d5e9ebad654a718827c0bd94bb5650 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:53.468107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.470196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:53.509328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 886/1767] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:53.516681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.568355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9004-e0fc-4951-93e7-24f89333de48 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.602226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26530bd-3d9e-4e9b-a308-06b3f98a1656 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.616399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.617099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.617537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.617900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.618549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.626613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.672258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 882/1768] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:53 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:53.677894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.723337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb9dd6-f36d-4c31-a8c3-860fa02e8add admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.751562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.753775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.756116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.757856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.764578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.774295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.792901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.794699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.795186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.795592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.796555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:53.798014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.801824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.820772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 887/1769] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:53.821842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 883/1770] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:53.825809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.826018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.846295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c6403-3f49-414e-b2aa-e3ae4b2bd7e7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.854455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.856266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.860324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.860970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.862383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514af12-55f2-4564-9fb3-bb8bf0a54aa5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:53.862584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.871761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.878283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:53.879586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:53.879925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:53.880238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] PATH_INFO: `/v3/projects/4c2daac18d7945bab5adcc29b50e02fe/users/e9ddf4183a534f1ab76894855f11dedb/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:53.917999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2daac18d7945bab5adcc29b50e02fe, user_id=e9ddf4183a534f1ab76894855f11dedb, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:53.922954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:53.959266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 884/1771] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:53 2022] PUT /identity/v3/projects/4c2daac18d7945bab5adcc29b50e02fe/users/e9ddf4183a534f1ab76894855f11dedb/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:53.959266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:53.959547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 888/1772] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:53 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:53.960454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.139183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df0ab-d07e-4201-8d73-7b4902f64756 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.151935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7f50-05a5-4c3f-9a2d-9df676c5a2db admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.158373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.159322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.159798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.160225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.161102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.162875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.168973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.169742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.170027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.170295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.171475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.174576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.195783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 889/1773] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:54.196911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.226759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e70e1a-8d41-4105-a89e-ead5eb920cd9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.233396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 885/1774] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:53 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:54.238315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.239181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.240232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.240675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.241077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] PATH_INFO: `/v3/projects/4c2daac18d7945bab5adcc29b50e02fe/users/e9ddf4183a534f1ab76894855f11dedb/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.245986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2daac18d7945bab5adcc29b50e02fe, user_id=e9ddf4183a534f1ab76894855f11dedb, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.248875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.277620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 890/1775] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:54 2022] PUT /identity/v3/projects/4c2daac18d7945bab5adcc29b50e02fe/users/e9ddf4183a534f1ab76894855f11dedb/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:54.280614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6cd3-47b3-4b43-ad78-a32f4fcc595a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.511675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.512562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.514069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.515919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.518584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.521065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.558556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 886/1776] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:54.562465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.591285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.593439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:54.603927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353b2b-f618-43ea-a35a-95fdefdd058d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.620836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.622797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.624488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.625148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.627678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.631873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.646558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dccd6-cc87-43ea-9132-d8c67807fbde admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.664056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.666437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.666890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.667336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] PATH_INFO: `/v3/users/c5c5f8834e5d4f12ae0dc45642403741` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.673750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 891/1777] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:54.676094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:54.687784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c5f8834e5d4f12ae0dc45642403741)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.692226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.705863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8343-7442-4c0a-be2f-2dcdd99d17f6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:54.723231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:54.725947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.726492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.727148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] PATH_INFO: `/v3/projects/ec693aa276da45feb891893d06402ae0/users/8832a9b30de443fbbff793fe9255c229/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.780029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec693aa276da45feb891893d06402ae0, user_id=8832a9b30de443fbbff793fe9255c229, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:54.790426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68a8e9-6628-4d80-bb7a-349ffd4daa37 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:54.804217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c5f8834e5d4f12ae0dc45642403741'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:54.805341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c5f8834e5d4f12ae0dc45642403741'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:54.806268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c5f8834e5d4f12ae0dc45642403741'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:54.834141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 892/1778] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:54 2022] PUT /identity/v3/projects/ec693aa276da45feb891893d06402ae0/users/8832a9b30de443fbbff793fe9255c229/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:54.842685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.843150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.843798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.849492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c5f8834e5d4f12ae0dc45642403741'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:54.872308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc7941fe-3c18-4dfb-8643-5d892b38b537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c5f8834e5d4f12ae0dc45642403741'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:54.924064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 887/1779] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:54 2022] DELETE /identity/v3/users/c5c5f8834e5d4f12ae0dc45642403741 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:56:54.928750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:54.929427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:54.930009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:54.953020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] MFA Rules not processed for user `8832a9b30de443fbbff793fe9255c229`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:54.956331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:54.998144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:55.003530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:55.195038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 893/1780] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:55.198179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:55.202368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:55.226410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 888/1781] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:55.298288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f42e84-5f2a-45dc-b5d9-e72da6cdae27 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:55.326182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:55.326984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:55.327323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:55.327644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:55.329283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:55.331379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:55.444124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 894/1782] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:55 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:55.445027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:55.450262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:55.452716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:55.465473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d492b-1e56-4cd0-a30b-48253cc211f6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:55.567443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582dd0-0df3-42c3-8bcb-7f7dcb929766 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:55.572780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:55.573685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:55.574202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:55.574714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:55.664824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:55.666503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:55.680578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:55.681145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:55.684701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:55.694525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d403-c726-421c-8719-18166a3910bc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:55.800145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 889/1783] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:55 2022] POST /identity/v3/users => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:55.803908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:55.804282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:55.804594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:55.858344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] MFA Rules not processed for user `ed75e7f09b1d4b60b45f7b024de32683`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:55.862753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:55.863264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:55.866869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:55.916440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 895/1784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:55.917037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:55.942111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07690bdd-fcee-49d6-8e98-ab0ba75552a8 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:55.959222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:55.960983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:55.962586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:55.963692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:55.964685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:55.970646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.014972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 896/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:56.018997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:56.034828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050ad57-9069-4731-a975-afe422cc7c86 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:56.045197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:56.046338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.046654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.046976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] PATH_INFO: `/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9/users/2ee28b96d1ad4e7a8e019e0c1772db1c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.074067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26ca066954c4ec6825d06fa3a2d9ba9, user_id=2ee28b96d1ad4e7a8e019e0c1772db1c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:56.077379 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.114826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 897/1786] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:56 2022] PUT /identity/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9/users/2ee28b96d1ad4e7a8e019e0c1772db1c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:56.122703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 890/1787] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:56.122901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:56.346627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56558f-1cb0-4d2f-8955-5f8a625b2226 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:56.361011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:56.361793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.362029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.362309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.363040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:56.364640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951807d-d59b-4c63-8f97-0f15efeccc0f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.417587 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 898/1788] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:56:56.419904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:56.443987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129d98-b9d2-4585-98a5-8d3013113f54 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:56.457947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:56.458874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.459236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.459467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] PATH_INFO: `/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9/users/2ee28b96d1ad4e7a8e019e0c1772db1c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.464125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26ca066954c4ec6825d06fa3a2d9ba9, user_id=2ee28b96d1ad4e7a8e019e0c1772db1c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:56.471191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.523129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 891/1789] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:56 2022] PUT /identity/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9/users/2ee28b96d1ad4e7a8e019e0c1772db1c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:56.534286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.534605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.534961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.609802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] MFA Rules not processed for user `2ee28b96d1ad4e7a8e019e0c1772db1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:56.614264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:56.642187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:56.644322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:56.813498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 899/1790] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:56:56.823143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:56.824895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:56.905549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bc9bd-de9a-4d92-aed2-fb0b71a9ed16 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:56.932245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:56.934228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.934520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.936710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] PATH_INFO: `/v3/projects/a44ef8c8eeeb4cd2bfb89e68be075b1c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.947635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44ef8c8eeeb4cd2bfb89e68be075b1c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:56.955405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.960597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c12bf-d078-4684-bdb2-eef621b720ca None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:56.966153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:56.967090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:56.967568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:56.968037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:56.983487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:56.986499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:56.999432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 900/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:57.149464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44ef8c8eeeb4cd2bfb89e68be075b1c', 'request_id': 'req-0a825afd-db3e-46b7-aacf-f459744587eb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.164876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:57.171940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44ef8c8eeeb4cd2bfb89e68be075b1c', 'request_id': 'req-0a825afd-db3e-46b7-aacf-f459744587eb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.187691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44ef8c8eeeb4cd2bfb89e68be075b1c', 'request_id': 'req-0a825afd-db3e-46b7-aacf-f459744587eb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.195503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086bf66-bbaf-4d17-a415-d44fe1a15c45 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:57.217692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] The token cache is being invalidate because project a44ef8c8eeeb4cd2bfb89e68be075b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:57.224114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.224992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.230015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 892/1792] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:56 2022] DELETE /identity/v3/projects/a44ef8c8eeeb4cd2bfb89e68be075b1c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:57.231240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:57.232883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:57.316406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:57.317068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:57.317551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:57.317870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:57.321568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:57.332983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a825afd-db3e-46b7-aacf-f459744587eb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:57.351057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:57.351943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:57.352224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:57.352498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] PATH_INFO: `/v3/projects/7eb1dedd957740f4a232fb094aac2df8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:57.357184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb1dedd957740f4a232fb094aac2df8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:57.364027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:57.545913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:57.549282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb1dedd957740f4a232fb094aac2df8', 'request_id': 'req-c7b079c3-9163-4049-8fbf-54139a62021f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.553256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:57.569796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb1dedd957740f4a232fb094aac2df8', 'request_id': 'req-c7b079c3-9163-4049-8fbf-54139a62021f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.587399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 901/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:56:57.589011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:57.591643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb1dedd957740f4a232fb094aac2df8', 'request_id': 'req-c7b079c3-9163-4049-8fbf-54139a62021f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.592444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:57.621464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] The token cache is being invalidate because project 7eb1dedd957740f4a232fb094aac2df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:57.623068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.625910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c7b079c3-9163-4049-8fbf-54139a62021f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:57.629973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 893/1794] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:57 2022] DELETE /identity/v3/projects/7eb1dedd957740f4a232fb094aac2df8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:57.631340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336f43-b3dc-4cdb-8570-141740c37a5b service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:57.635342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90974-583a-4e59-b62c-c314c7d2e543 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:57.635747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90974-583a-4e59-b62c-c314c7d2e543 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:57.636129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90974-583a-4e59-b62c-c314c7d2e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:57.726756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-62f90974-583a-4e59-b62c-c314c7d2e543 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:57.736195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-62f90974-583a-4e59-b62c-c314c7d2e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:57.970656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:57.971527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:57.972168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:57.972168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] PATH_INFO: `/v3/users/36d25bc0422641db88cbb4878fe35e57` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:57.980203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d25bc0422641db88cbb4878fe35e57)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:57.984726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:57.991596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 894/1795] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:57.999484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:57.999750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.000054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.078664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:58.081001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:58.093127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 895/1796] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:58.097980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.104100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d25bc0422641db88cbb4878fe35e57'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:58.105393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d25bc0422641db88cbb4878fe35e57'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:58.106311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d25bc0422641db88cbb4878fe35e57'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:58.116159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa9ba1-fc9b-4743-8836-b6e654f8a3a4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.127248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d25bc0422641db88cbb4878fe35e57'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:58.133901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.134590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.134910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.135184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.136321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:56:58.136643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.138676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.147291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5bfb514d-d954-41ac-a5e5-fc7e05d03183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d25bc0422641db88cbb4878fe35e57'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:58.186377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 896/1797] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:56:58.195769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.198173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:58.201784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 902/1798] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:56:57 2022] DELETE /identity/v3/users/36d25bc0422641db88cbb4878fe35e57 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:58.237628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771cec-5bb8-4945-9f3e-0b248816211f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.467479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.469737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.470194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.470625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.471477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.473559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b9712-a420-4f90-ad4c-ed3ff669fb9b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.525137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61314-8fa9-4c76-b5b4-33cd9b8905f4 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.525434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61314-8fa9-4c76-b5b4-33cd9b8905f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.525762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61314-8fa9-4c76-b5b4-33cd9b8905f4 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.531728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 903/1799] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:56:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:56:58.534406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 897/1800] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:58 2022] POST /identity/v3/projects => generated 379 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:58.540134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61314-8fa9-4c76-b5b4-33cd9b8905f4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.706836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61314-8fa9-4c76-b5b4-33cd9b8905f4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.712714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.713398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.713712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.713990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.715048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.717920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.731031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.731571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.731856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.756322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:58.760091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 904/1801] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:58 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:58.761608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:58.763255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.778015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3532449-28c0-4196-9711-07d1bc1c5df2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.787496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.789238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.789638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.790063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.792615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.794870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.817570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 905/1802] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:56:58.821697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.845259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70395d-b606-4084-8e2e-e24790332603 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.851642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.852545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.852923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.853181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.854159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.855885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01e3ca-102b-4060-a01c-72986bdc361a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.863033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 898/1803] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:58.892014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:58.899164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 906/1804] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:56:58.904565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f20ab9-6f92-48f1-a76b-288f80c7286b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:58.913399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:58.914438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.914867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.915240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] PATH_INFO: `/v3/projects/1282dcf3608d4aa98a0d93a9f2948033/users/b9bd28c8b00244c583cdb4679138ebe0/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:58.935459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1282dcf3608d4aa98a0d93a9f2948033, user_id=b9bd28c8b00244c583cdb4679138ebe0, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:58.938401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:58.957813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 899/1805] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:56:58 2022] PUT /identity/v3/projects/1282dcf3608d4aa98a0d93a9f2948033/users/b9bd28c8b00244c583cdb4679138ebe0/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:58.969713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:58.970004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:58.970448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:59.004178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] MFA Rules not processed for user `b9bd28c8b00244c583cdb4679138ebe0`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:56:59.005721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:59.097811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:59.098732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 907/1806] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:56:59.267204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9deae-3ff6-4f57-9206-431a23316a53 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:59.273734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:59.274889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:59.275430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:59.275942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:59.277365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:59.282145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:59.380466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:59.382173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:59.441113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 900/1807] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:56:59 2022] POST /identity/v3/projects => generated 379 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:59.450052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:59.462108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db986-2dc1-42e5-9fc8-de5a682c7931 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:59.635135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff27a7-da48-4dce-90eb-7d5a7f33a687 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:56:59.646774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:59.647864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:59.648149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:59.648420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] PATH_INFO: `/v3/projects/1fa290a928cb4f2aa202a6413d9a9274` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:59.649568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:56:59.650240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa290a928cb4f2aa202a6413d9a9274)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:59.650773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:56:59.651194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:56:59.651688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:56:59.652143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:59.652875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:56:59.655659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:56:59.709829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 901/1808] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:56:59 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:56:59.712922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:59.718498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:59.760272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa290a928cb4f2aa202a6413d9a9274', 'request_id': 'req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:59.767898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa290a928cb4f2aa202a6413d9a9274', 'request_id': 'req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:59.780085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa290a928cb4f2aa202a6413d9a9274', 'request_id': 'req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:59.808945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] The token cache is being invalidate because project 1fa290a928cb4f2aa202a6413d9a9274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:56:59.809245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:59.810023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:56:59.813921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 908/1809] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:56:59 2022] DELETE /identity/v3/projects/1fa290a928cb4f2aa202a6413d9a9274 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:56:59.815209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:56:59.819630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:56:59.942221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d9c5-f9b3-45f0-a89f-4c60e3497191 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.020337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6731f-f35d-4cdc-8cf6-167817e8a52e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.041006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.041775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.042481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.043003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.043988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.047774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf77e-a90b-4ef8-8456-8e3e4663ab85 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.082921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 909/1810] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:00.084636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.084972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.085252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.124647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.127588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.127966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.128947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.133285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:00.134395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:00.135121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:00.157518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.160319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2714f-96c5-4733-9cae-5c91b8c3edf6 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.160765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 910/1811] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:00.168107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.192828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23ea3-401e-4b8c-9f35-c3f6588ce7f2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.202013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.202750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.203031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.203310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.204049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.205634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 902/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:56:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:00.207720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.230943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.231358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.231837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 911/1813] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:00.231945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.236623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.255956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe1367-276f-4170-879c-83a6bb9ff11b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.271738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.272545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.272829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.273114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] PATH_INFO: `/v3/projects/ee7c2622f89548b69ed496911e2afe86/users/86ddf7ea78a24f358ce6c874ebe2b9b7/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.291050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:00.293906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:00.308132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7c2622f89548b69ed496911e2afe86, user_id=86ddf7ea78a24f358ce6c874ebe2b9b7, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.311003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83f225-6cc2-41f2-bf8f-796826b2c79f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.333308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 903/1814] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:00.337620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.351976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 912/1815] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:00 2022] PUT /identity/v3/projects/ee7c2622f89548b69ed496911e2afe86/users/86ddf7ea78a24f358ce6c874ebe2b9b7/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:00.354831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.355664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.355664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.386127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ccba5-9942-4cf3-a46f-766cc794eb3a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.412725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] MFA Rules not processed for user `86ddf7ea78a24f358ce6c874ebe2b9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:00.412725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:00.581088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 913/1816] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:00.588383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.589082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.589365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.589639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.590482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.592610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:00.594649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.598159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.617226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5bd1-fdbb-45e9-8666-1000ab19bc5b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.633990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.639453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 904/1817] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:00.639901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.640669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.641990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.642431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.643260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.647840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.664526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a038bc-2507-473a-b170-15c4b12bfe6b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.676638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.677561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.679308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.679587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.681217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.687779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:00.716088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 914/1818] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:00.717191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.758511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 905/1819] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:00.763255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:00.898988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ff709-2fd0-4638-932c-5f86935c508c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.951365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f107-3148-4c64-acfe-db377ee5341b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:00.967383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:00.969093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:00.969919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:00.970347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:00.971201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:00.975082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.027227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 906/1820] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:01.031489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.053696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.054369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.054655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.054936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.055784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074a3f-d138-454f-a6a2-d2350e6e2d9f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.057286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.060881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.066783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.069876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.070296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.070579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.071321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.074278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.119238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 907/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:01.130356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 915/1822] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:00 2022] POST /identity/v3/users => generated 296 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:01.130540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.142518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a985d5d-2079-4f7d-af6d-b555948802c8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.143530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.149469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.150259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.150543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.150819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.151727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.154270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.166424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d94b3-9646-4a40-994c-03d73f73b6b4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.172151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 908/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:01.173031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.176592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.178102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.178737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.179211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.180239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.182678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.183138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c70a6-ac7f-4e4c-b576-2930fa3c2641 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.190493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.191667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.192670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.192670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] PATH_INFO: `/v3/projects/35e7569ad1cb496d84f7b02b8e9a447d/users/58d865909ce24f81b5a39adce7deca28/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.202444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 916/1824] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:01.207970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.210779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e7569ad1cb496d84f7b02b8e9a447d, user_id=58d865909ce24f81b5a39adce7deca28, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.214368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef900-7ec3-4e16-b65a-fa4ebd711a70 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.220817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f87adb-e82e-4748-b2f8-e48fa2426eb4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.232677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.234363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.235114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 909/1825] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:01 2022] PUT /identity/v3/projects/35e7569ad1cb496d84f7b02b8e9a447d/users/58d865909ce24f81b5a39adce7deca28/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:01.235747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.236300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] PATH_INFO: `/v3/projects/0673b618bb2c4693944f21606ab7ed51/users/520f6d44ae44430cba208edd7b499a97/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.255749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.256034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.256310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.289326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0673b618bb2c4693944f21606ab7ed51, user_id=520f6d44ae44430cba208edd7b499a97, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.291445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] MFA Rules not processed for user `58d865909ce24f81b5a39adce7deca28`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:01.293100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.293596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.327770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 917/1826] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:01 2022] PUT /identity/v3/projects/0673b618bb2c4693944f21606ab7ed51/users/520f6d44ae44430cba208edd7b499a97/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:01.329089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.332153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.453103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 910/1827] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:01.459659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.502170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc614d-d4d1-4515-83b9-3c74affe5b1e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.515260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.516676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.517064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.517458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] PATH_INFO: `/v3/users/8832a9b30de443fbbff793fe9255c229` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.519383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8832a9b30de443fbbff793fe9255c229)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.526157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.586692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c137d5-32ab-4d69-9cb8-ae086768085c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.592704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.594048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.594386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.594824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.595633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.597416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b2eb6-afc5-4708-a764-b0563b4e7d49 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.609862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 911/1828] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:01.614134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8832a9b30de443fbbff793fe9255c229'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:01.615400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.615400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.615400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.615688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8832a9b30de443fbbff793fe9255c229'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:01.616048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8832a9b30de443fbbff793fe9255c229'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:01.647836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] MFA Rules not processed for user `e9ddf4183a534f1ab76894855f11dedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:01.649056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.655228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8832a9b30de443fbbff793fe9255c229'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:01.674402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8832a9b30de443fbbff793fe9255c229'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:01.701833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 918/1829] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:01 2022] DELETE /identity/v3/users/8832a9b30de443fbbff793fe9255c229 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:01.701833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.703419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.725928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 912/1830] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:01.726768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.728068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.742402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cd22a-7950-418d-94ee-c220eee65d93 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.804597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34815-0a32-47fb-887b-9637b6c570cb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.805053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.806000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.806280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.806553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] PATH_INFO: `/v3/projects/0673b618bb2c4693944f21606ab7ed51/users/520f6d44ae44430cba208edd7b499a97/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.808976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0673b618bb2c4693944f21606ab7ed51, user_id=520f6d44ae44430cba208edd7b499a97, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.813223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ef77-0c97-4c64-812e-fe63be1f7988 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.813929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:01.816149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.816149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.817584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.821630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.849888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 913/1831] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:01 2022] PUT /identity/v3/projects/0673b618bb2c4693944f21606ab7ed51/users/520f6d44ae44430cba208edd7b499a97/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:01.861822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705359-af94-4b2c-abcb-6f54ef3d2777 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:01.862125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705359-af94-4b2c-abcb-6f54ef3d2777 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:01.862403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705359-af94-4b2c-abcb-6f54ef3d2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:01.891348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ff705359-af94-4b2c-abcb-6f54ef3d2777 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:01.892909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ff705359-af94-4b2c-abcb-6f54ef3d2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.922470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:01.924198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:01.945915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 919/1832] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:01.947288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:01.948446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:01.963529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e65b-181e-46a9-91b3-2091d01b9187 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:01.999136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 914/1833] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:02.001159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.001313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.001480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.033279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.034402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.034910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.035401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.039740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.040510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] MFA Rules not processed for user `520f6d44ae44430cba208edd7b499a97`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:02.041812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.119098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.121120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.133420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 920/1834] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:02.134735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.136686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.162107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861219-40a8-4902-aee1-db019294f30f service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.173263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.174316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.175899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 915/1835] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:02.176292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.176745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] PATH_INFO: `/v3/users/58d865909ce24f81b5a39adce7deca28` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.179014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d865909ce24f81b5a39adce7deca28)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.179606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.183172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.185181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.264619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d865909ce24f81b5a39adce7deca28'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:02.266235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d865909ce24f81b5a39adce7deca28'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:02.267349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d865909ce24f81b5a39adce7deca28'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:02.284067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d865909ce24f81b5a39adce7deca28'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:02.289227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad347b-6c55-4d00-91cf-1ca9dd6a2a1e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.298278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d865909ce24f81b5a39adce7deca28'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:02.300603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.301393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.301789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.302273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.310000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.318596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 921/1836] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:02 2022] DELETE /identity/v3/users/58d865909ce24f81b5a39adce7deca28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:02.319812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.322188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.342710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.344961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e920f-064d-4946-b358-b5f8e4578ac3 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.361906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 916/1837] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:02.363305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d830-051d-427c-bd99-ebd4f3264b67 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.363701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d830-051d-427c-bd99-ebd4f3264b67 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.364022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d830-051d-427c-bd99-ebd4f3264b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.395431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9392d830-051d-427c-bd99-ebd4f3264b67 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:02.396820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9392d830-051d-427c-bd99-ebd4f3264b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.416867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9935af-fb3a-4c01-ae93-3faadd025dda admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.425003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.425800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.426412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.426718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.433147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.539829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 917/1838] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:02.539829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.539829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.540839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.542448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 918/1839] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:57:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:57:02.549358 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.551007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.598555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.600200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119db4f-3744-4c18-af64-e45a320fe5ac service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.613082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 922/1840] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:02.614530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.614815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.615092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.634591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a2d7-9eea-4f18-ab12-3ad2f17395a8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.639685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.640459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.641319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.641603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.649521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:02.651515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.652989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.654587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.669974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 919/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:02.701385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.716571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a74d3-9732-4abd-b7ee-b66683429be3 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.725476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.726891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.727501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.728133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.733624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.805177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 923/1842] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:02.823668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:02.824702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:02.855242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393997d-816d-4863-9c92-67e02f887a75 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:02.883118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:02.883795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:02.884078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:02.884361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:02.899781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:02.902240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:02.954883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 924/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:02.998496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:03.001192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:03.054386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 920/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:04.106158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:04.107844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.116348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:04.118938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.133579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0c6f-22ec-45ab-8e0c-ed725503c512 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:04.135884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9624-522c-484d-9d76-e97755b557cf service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:04.143663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:04.146107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.146792 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:04.146928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.147104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] PATH_INFO: `/v3/projects/ec693aa276da45feb891893d06402ae0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.147432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.147432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.147729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.149050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec693aa276da45feb891893d06402ae0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:04.151285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:04.155470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.237529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec693aa276da45feb891893d06402ae0', 'request_id': 'req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.243921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec693aa276da45feb891893d06402ae0', 'request_id': 'req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.251007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec693aa276da45feb891893d06402ae0', 'request_id': 'req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.263831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:04.266294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:04.278024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 921/1845] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:04.303830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] The token cache is being invalidate because project ec693aa276da45feb891893d06402ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:04.304125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.306058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.308284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 925/1846] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:04 2022] DELETE /identity/v3/projects/ec693aa276da45feb891893d06402ae0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:04.312006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:04.324275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf2b6-15a1-4c9c-a608-c98901a5c268 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:04.414064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:04.415463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.416007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.416187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] PATH_INFO: `/v3/users/2ee28b96d1ad4e7a8e019e0c1772db1c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.421062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee28b96d1ad4e7a8e019e0c1772db1c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:04.421432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:04.442626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:04.444086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.465495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea5d3-b8d0-423c-a92f-46a91496f7e7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:04.489678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:04.489853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee28b96d1ad4e7a8e019e0c1772db1c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.490868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.490980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee28b96d1ad4e7a8e019e0c1772db1c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.491054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.491121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] PATH_INFO: `/v3/projects/35e7569ad1cb496d84f7b02b8e9a447d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.491604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee28b96d1ad4e7a8e019e0c1772db1c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.492879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e7569ad1cb496d84f7b02b8e9a447d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:04.494823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:04.514241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee28b96d1ad4e7a8e019e0c1772db1c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.530064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-521e6006-d577-4dbe-bbe2-cd8b1ca8298a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee28b96d1ad4e7a8e019e0c1772db1c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.550760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 922/1847] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:04 2022] DELETE /identity/v3/users/2ee28b96d1ad4e7a8e019e0c1772db1c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:04.600491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e7569ad1cb496d84f7b02b8e9a447d', 'request_id': 'req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.613606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e7569ad1cb496d84f7b02b8e9a447d', 'request_id': 'req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.627572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e7569ad1cb496d84f7b02b8e9a447d', 'request_id': 'req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.657158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] The token cache is being invalidate because project 35e7569ad1cb496d84f7b02b8e9a447d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:04.657530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.658324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e215b7f-68c8-46a8-8088-fdd5fd8006c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:04.660909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 926/1848] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:04 2022] DELETE /identity/v3/projects/35e7569ad1cb496d84f7b02b8e9a447d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:04.668807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.670917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.671425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.705555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:04.707196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.828652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 923/1849] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:04.837011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.837669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.838162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.887279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:04.888593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:04.911005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 927/1850] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:04.918336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:04.948693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae785fd-0dc0-4592-8c61-d2eaae12772c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:04.959183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:04.960034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:04.960755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:04.961129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:04.962192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:04.963267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:04.966507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:04.986334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 924/1851] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:04.991041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.029586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1e8d0-eb3d-44b4-a17c-a44124832240 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.040279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.040957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.041240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.043398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.046050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.048938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.110430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 928/1852] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:05.114459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.136176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a508be0-3a7b-43f3-bc50-16c8849c1289 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.231215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.231915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.232288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.232620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.233367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.236700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.273957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 925/1853] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:05 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:05.274098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.288000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f20d-84e1-4799-a85e-62bc84b9078f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.303468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.304216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.304507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.304907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.306107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.308503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.321757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 929/1854] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:05.325596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.335975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500bcf4-d799-45fb-94cd-21142cc5ab9c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.341164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.341878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.342182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.342442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.343749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.345543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be298347-91e8-4da9-923d-ad19b827a080 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.357905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 926/1855] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:05.361797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.371738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271222da-682e-427d-b4a9-af9537084f28 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.377510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.378837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.379362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.379873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] PATH_INFO: `/v3/projects/52350670b4a94b3e8261911eac64ab5e/users/cb60e886813547c28884322cfb075072/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.400591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=52350670b4a94b3e8261911eac64ab5e, user_id=cb60e886813547c28884322cfb075072, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.403771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.433748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 930/1856] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:05 2022] PUT /identity/v3/projects/52350670b4a94b3e8261911eac64ab5e/users/cb60e886813547c28884322cfb075072/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:05.439171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.440333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.440658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.480861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] MFA Rules not processed for user `cb60e886813547c28884322cfb075072`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:05.482137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:05.588500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 927/1857] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:05.590421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.598875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:05.600563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:05.614060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:05.680081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9d6d-c40d-447c-9e78-746e971f73d7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.685639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.686531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.687292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.687671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.697748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.700287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21791981-d3b1-40b8-b8b4-d526079c2702 service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.720217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 928/1858] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:05.795436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709fd0-1af4-43ab-9075-61dc0ff2c2fd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:05.807148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:05.808093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:05.808283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:05.808553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] PATH_INFO: `/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:05.811138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26ca066954c4ec6825d06fa3a2d9ba9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:05.812525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:05.923608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26ca066954c4ec6825d06fa3a2d9ba9', 'request_id': 'req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:05.930564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26ca066954c4ec6825d06fa3a2d9ba9', 'request_id': 'req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:05.938184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26ca066954c4ec6825d06fa3a2d9ba9', 'request_id': 'req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:05.982768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] The token cache is being invalidate because project e26ca066954c4ec6825d06fa3a2d9ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:05.983280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:05.986441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1cb87d03-9c9e-4a46-9fcb-2004aed83de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.001030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 931/1859] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:05 2022] DELETE /identity/v3/projects/e26ca066954c4ec6825d06fa3a2d9ba9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:06.006204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.006575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.006929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.036115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:06.038032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.165695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 929/1860] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:06.173487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.174022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.174325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.216853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:06.218610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.242434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 932/1861] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:06.247177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.261468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462732c-9658-47c3-aa1a-0b8af83d24ec None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.269750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.271272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.271617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.271929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.272670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:06.273334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.275383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.301001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:06.305416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.331435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c80374-3941-4ae6-86c1-9b536c86638b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.356880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.357849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.358525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.359514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.360684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.363409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.403584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 933/1863] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:06.409049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.424955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72741a12-f7d6-4572-b285-92c42a4953ed admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.510644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.511327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.511606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.511997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.512971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.516141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.538124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.540554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.545927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 931/1864] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:06.548521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.563239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398433-62d8-4622-b814-aa8124e93126 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.571227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.572860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd125-e865-4bda-851b-0d88e3bdb4fe admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.573351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.573878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.574159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] PATH_INFO: `/v3/users/b9bd28c8b00244c583cdb4679138ebe0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.575882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bd28c8b00244c583cdb4679138ebe0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.578912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.579471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.579920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.580352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.580717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.581566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.583717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.597935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 932/1865] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:06.598921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.609975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9df4a-0853-402f-a08f-2114bedad26f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.615096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.615841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.616191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.616559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.617372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.619212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.638761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 933/1866] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:06.638761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.652932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdae-fc9d-4a13-bdcc-4f6b380584c5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.659684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.660587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.661518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.661894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] PATH_INFO: `/v3/projects/65121d977ec04ebea981a4b8a01c4207/users/f083cb21ffd04a15a38cdcde16d6c5fc/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.679386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bd28c8b00244c583cdb4679138ebe0'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.680162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bd28c8b00244c583cdb4679138ebe0'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.681167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bd28c8b00244c583cdb4679138ebe0'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.694323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=65121d977ec04ebea981a4b8a01c4207, user_id=f083cb21ffd04a15a38cdcde16d6c5fc, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.699357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446959c-a18b-4c7f-96ea-ebd7ace506dc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.706512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bd28c8b00244c583cdb4679138ebe0'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.725556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a703c07c-7cd2-46f5-b0ea-4c99b9396448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bd28c8b00244c583cdb4679138ebe0'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:06.726651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 934/1867] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:06 2022] PUT /identity/v3/projects/65121d977ec04ebea981a4b8a01c4207/users/f083cb21ffd04a15a38cdcde16d6c5fc/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:06.742996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.743298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.743604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.757698 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 934/1868] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:06 2022] DELETE /identity/v3/users/b9bd28c8b00244c583cdb4679138ebe0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:06.760157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.760609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.760892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.772978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] MFA Rules not processed for user `f083cb21ffd04a15a38cdcde16d6c5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:06.776708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.782778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:06.784975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.855924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 935/1869] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:06.865250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 935/1870] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:06.869714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.873960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:06.876049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.876503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:06.893008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302873c0-aad7-49da-825d-f20c8f0c57e4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.899300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:06.900107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:06.900664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:06.903316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:06.906134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:06.908082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:06.953037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86709a91-2ac9-4bb4-94cb-b27e88a8f295 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:06.954409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 936/1871] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:06.958479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.021131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.021830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.022114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.022388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.060754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9834-264d-4a71-bf36-108b1b186e6b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.082174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.082877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.083160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.083437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.084286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.086099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.115985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.116213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 937/1872] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:06 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:07.116329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.118457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.126059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 936/1873] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:07.132911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0811a-9004-4069-8164-b9af872e570b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.137743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.138860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.138860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.139053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.139751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.142282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.155683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 938/1874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:07.160653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.179131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3221ba-b3e5-42a9-a374-8f490d178bc2 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.186411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.187480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.187768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.188992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] PATH_INFO: `/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a/users/cd917fa73f7e4ab0ab1025ccc673b912/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.219023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715bf5ccbc284ca2bc6d0cdff0e91c5a, user_id=cd917fa73f7e4ab0ab1025ccc673b912, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.226314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.249097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.250347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 937/1875] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:07 2022] PUT /identity/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a/users/cd917fa73f7e4ab0ab1025ccc673b912/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:07.260737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a871ea-28bb-4904-846b-eb5ac86e69cf admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.328524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.329199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.329483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.329797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.330523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.332118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb453d-b855-4e67-8144-27d41cd8501e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.345834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 939/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:07.347490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.358062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79014-13b4-4f66-8aff-92502645bf55 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.363224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.366463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.366463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.366463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] PATH_INFO: `/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a/users/cd917fa73f7e4ab0ab1025ccc673b912/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.371146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715bf5ccbc284ca2bc6d0cdff0e91c5a, user_id=cd917fa73f7e4ab0ab1025ccc673b912, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.374012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.405675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 938/1877] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:07 2022] PUT /identity/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a/users/cd917fa73f7e4ab0ab1025ccc673b912/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:07.417519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.417828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.418121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.455377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] MFA Rules not processed for user `cd917fa73f7e4ab0ab1025ccc673b912`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:07.456630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:07.601836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 940/1878] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:07.609117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.611100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:07.694008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934f36-3556-43bc-a51f-fa085132c2f9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.701921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.703735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.704885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.705598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.716641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.718301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.720740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.724070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:07.730744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 939/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:07.806060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3599-b9bd-43fb-8628-d96a5a90044b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:07.810579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:07.811442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:07.812278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:07.812596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] PATH_INFO: `/v3/projects/1282dcf3608d4aa98a0d93a9f2948033` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:07.813795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1282dcf3608d4aa98a0d93a9f2948033)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:07.815944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:07.867571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1282dcf3608d4aa98a0d93a9f2948033', 'request_id': 'req-128b4943-d527-445f-94ef-fe7517d1a2e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:07.877612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1282dcf3608d4aa98a0d93a9f2948033', 'request_id': 'req-128b4943-d527-445f-94ef-fe7517d1a2e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:07.889298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1282dcf3608d4aa98a0d93a9f2948033', 'request_id': 'req-128b4943-d527-445f-94ef-fe7517d1a2e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:07.926914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] The token cache is being invalidate because project 1282dcf3608d4aa98a0d93a9f2948033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:07.927201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:07.927903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-128b4943-d527-445f-94ef-fe7517d1a2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:07.929685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 941/1880] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:07 2022] DELETE /identity/v3/projects/1282dcf3608d4aa98a0d93a9f2948033 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:07.933449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:07.947299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c3353-af17-4498-b35e-e08c866dade1 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:08.053213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:08.055196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:08.055196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:08.055486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] PATH_INFO: `/v3/users/86ddf7ea78a24f358ce6c874ebe2b9b7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:08.057019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ddf7ea78a24f358ce6c874ebe2b9b7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:08.060350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:08.132970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ddf7ea78a24f358ce6c874ebe2b9b7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:08.133909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ddf7ea78a24f358ce6c874ebe2b9b7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:08.137220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ddf7ea78a24f358ce6c874ebe2b9b7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:08.157827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ddf7ea78a24f358ce6c874ebe2b9b7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:08.172787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b614272-235a-4fcc-b281-1138c3417868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ddf7ea78a24f358ce6c874ebe2b9b7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:08.197450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 940/1881] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:07 2022] DELETE /identity/v3/users/86ddf7ea78a24f358ce6c874ebe2b9b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:08.589236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:08.589881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:08.590183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:08.591706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 942/1882] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:57:08.603364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:08.603659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:08.603942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:08.644329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:08.645567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:08.828606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 941/1883] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:09.162078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:09.164264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:09.341295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac616f-e640-4596-9756-54ef67c66fb0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:09.349052 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:09.350443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:09.350895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:09.351514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] PATH_INFO: `/v3/projects/ee7c2622f89548b69ed496911e2afe86` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:09.353686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7c2622f89548b69ed496911e2afe86)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:09.356719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:09.450689 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7c2622f89548b69ed496911e2afe86', 'request_id': 'req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.457162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7c2622f89548b69ed496911e2afe86', 'request_id': 'req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.464080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7c2622f89548b69ed496911e2afe86', 'request_id': 'req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.493018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] The token cache is being invalidate because project ee7c2622f89548b69ed496911e2afe86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:09.493495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.494535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.496598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 943/1884] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:09 2022] DELETE /identity/v3/projects/ee7c2622f89548b69ed496911e2afe86 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:09.502438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:09.518601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb6a75-65e6-4a4b-aafe-50e1c940ae61 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:09.594608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:09.596216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:09.596505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:09.596924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] PATH_INFO: `/v3/users/520f6d44ae44430cba208edd7b499a97` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:09.599726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520f6d44ae44430cba208edd7b499a97)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:09.602072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:09.671443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520f6d44ae44430cba208edd7b499a97'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.672309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520f6d44ae44430cba208edd7b499a97'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.672950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520f6d44ae44430cba208edd7b499a97'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.688579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520f6d44ae44430cba208edd7b499a97'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.697129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520f6d44ae44430cba208edd7b499a97'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:09.716549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 942/1885] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:09 2022] DELETE /identity/v3/users/520f6d44ae44430cba208edd7b499a97 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:09.730888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:09.732580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:09.844568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f3fe9-fed7-47b3-a39d-e1cd7355091d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:09.926030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:09.926837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:09.927122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:09.927398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:09.929918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:09.945728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:09.947829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:09.968886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 944/1886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:09.983030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:09.984212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.095521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478de4c-2cb1-4b78-a4f3-37c73fa2e899 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.103063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.104498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.104982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.105453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] PATH_INFO: `/v3/users/f083cb21ffd04a15a38cdcde16d6c5fc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.107381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f083cb21ffd04a15a38cdcde16d6c5fc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.115862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.157406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.159114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.175147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8747f-3880-4661-ae19-c3c33a8ab975 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.190558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.192300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.192988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.193510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] PATH_INFO: `/v3/projects/0673b618bb2c4693944f21606ab7ed51` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.195679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0673b618bb2c4693944f21606ab7ed51)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.196264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f083cb21ffd04a15a38cdcde16d6c5fc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.198653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.198785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f083cb21ffd04a15a38cdcde16d6c5fc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.199495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f083cb21ffd04a15a38cdcde16d6c5fc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.217966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f083cb21ffd04a15a38cdcde16d6c5fc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.240043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a4b4380-2711-43c4-ae3e-a70684f631c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f083cb21ffd04a15a38cdcde16d6c5fc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.262693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 943/1887] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:09 2022] DELETE /identity/v3/users/f083cb21ffd04a15a38cdcde16d6c5fc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:10.264611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.264828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0673b618bb2c4693944f21606ab7ed51', 'request_id': 'req-a9ed3635-8204-47f5-aecd-445364568b25'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.265203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.265689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.272522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0673b618bb2c4693944f21606ab7ed51', 'request_id': 'req-a9ed3635-8204-47f5-aecd-445364568b25'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.280147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0673b618bb2c4693944f21606ab7ed51', 'request_id': 'req-a9ed3635-8204-47f5-aecd-445364568b25'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.288187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:10.290100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.308362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] The token cache is being invalidate because project 0673b618bb2c4693944f21606ab7ed51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:10.308655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.309578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a9ed3635-8204-47f5-aecd-445364568b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:10.311558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 945/1888] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:10 2022] DELETE /identity/v3/projects/0673b618bb2c4693944f21606ab7ed51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:10.318787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a09a-2298-4ff3-a3b2-62c25571a654 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.319141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a09a-2298-4ff3-a3b2-62c25571a654 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.319766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a09a-2298-4ff3-a3b2-62c25571a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.361314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f4d6a09a-2298-4ff3-a3b2-62c25571a654 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:10.364143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f4d6a09a-2298-4ff3-a3b2-62c25571a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.377602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 944/1889] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:10.388576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.390372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.492415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 946/1890] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:10.494192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.494514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.494837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.526895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b1623-675f-4159-adf3-fe903fc516a1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.530216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:10.532528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:10.539192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.539858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.540136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.541245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.550492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 947/1891] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:10.556150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.571754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.574147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.582625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e260a7-ac26-4c78-a3b2-7e78ed81c8b6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.588340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.589051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.589333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.589813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.590635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:10.590944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.594055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.603588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 945/1892] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:10.623324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 948/1893] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:10.624438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.636238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c4aba-878e-4ec0-af9f-6eccaa83e5a1 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.644623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.645933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.646332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.646888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.647954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.650594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.706224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.716321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 946/1894] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:10 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:10.722991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4025fcd-1f93-4295-b55d-d6cb756c0efb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.818132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.819148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.819727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.820074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.820923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.823972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.868048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 949/1895] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:10 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:10.871936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.886271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e93a-f5c9-41fb-ab6e-b00e2d7b60ea admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.893946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.894314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.894857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.895199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.896046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.898716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.917597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 947/1896] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:10.919513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.937546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e444f0-91d3-4f59-bd27-f6acc09fde1e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:10.944180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:10.945167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:10.945631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:10.946770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:10.948410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:10.950990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:10.970055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 950/1897] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:10.973605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:10.997678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2836-a08f-41eb-b990-f081e00c65df admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.007916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.009336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.009832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.010321 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] PATH_INFO: `/v3/projects/2b3aa3f652ea4d0ab0ee78ca173514c1/users/5992dfe48ae54b049df14a9701666ba2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.028633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.032988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:11.033180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3aa3f652ea4d0ab0ee78ca173514c1, user_id=5992dfe48ae54b049df14a9701666ba2, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.036706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60f3b8-65aa-4be1-b1eb-a9c3159f94b8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.054151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce70cdc-5aa7-4fc0-9c7d-715fc9bc408b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.060573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.062777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.063351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.063756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] PATH_INFO: `/v3/projects/65121d977ec04ebea981a4b8a01c4207` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.065665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65121d977ec04ebea981a4b8a01c4207)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.068251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.078113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 948/1898] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:10 2022] PUT /identity/v3/projects/2b3aa3f652ea4d0ab0ee78ca173514c1/users/5992dfe48ae54b049df14a9701666ba2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:11.083283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.083639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.083923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.133568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65121d977ec04ebea981a4b8a01c4207', 'request_id': 'req-68a12f00-92ac-416f-a942-ea6b169a430d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.141500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65121d977ec04ebea981a4b8a01c4207', 'request_id': 'req-68a12f00-92ac-416f-a942-ea6b169a430d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.157289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65121d977ec04ebea981a4b8a01c4207', 'request_id': 'req-68a12f00-92ac-416f-a942-ea6b169a430d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.157894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] MFA Rules not processed for user `5992dfe48ae54b049df14a9701666ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:11.159745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:11.184949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] The token cache is being invalidate because project 65121d977ec04ebea981a4b8a01c4207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:11.185239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.194413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.199143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 951/1899] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:11 2022] DELETE /identity/v3/projects/65121d977ec04ebea981a4b8a01c4207 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:11.204164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.206536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:11.277709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 949/1900] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:11.282842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.284160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:11.301895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a12f00-92ac-416f-a942-ea6b169a430d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.314524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.316620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.317417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.318443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] PATH_INFO: `/v3/users/cd917fa73f7e4ab0ab1025ccc673b912` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.320210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd917fa73f7e4ab0ab1025ccc673b912)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.322921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.408050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212388b-4e11-41f8-9a67-5bc63a7182ac None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.412908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.413696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.414051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.414424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.415177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.417475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.418711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd917fa73f7e4ab0ab1025ccc673b912'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.419367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd917fa73f7e4ab0ab1025ccc673b912'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.420053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd917fa73f7e4ab0ab1025ccc673b912'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.442107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd917fa73f7e4ab0ab1025ccc673b912'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.452442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 950/1901] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:11 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:11.452644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd917fa73f7e4ab0ab1025ccc673b912'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:11.453829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.456045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:11.464475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 952/1902] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:11 2022] DELETE /identity/v3/users/cd917fa73f7e4ab0ab1025ccc673b912 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:11.542855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f623eb-b009-4dfe-b1ae-c5d0961d8779 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.624481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.625561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.625875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.626147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.626992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.628735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.670112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 951/1903] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:11 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:11.671350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.688080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1f5e-852d-461b-9601-31fdd223aa75 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.715937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.717425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.717425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.717425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.718490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.720648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.737708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 953/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:11.739293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.752357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145c9e-45b7-469d-999c-5d6eb91e40cf admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.763041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.764127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.765220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.765684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] PATH_INFO: `/v3/projects/58478a9630c94e5caa82a2fc398ab538/users/b0e02b52259643a59444b624b85119b1/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.794560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58478a9630c94e5caa82a2fc398ab538, user_id=b0e02b52259643a59444b624b85119b1, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.797868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.820119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 952/1905] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:11 2022] PUT /identity/v3/projects/58478a9630c94e5caa82a2fc398ab538/users/b0e02b52259643a59444b624b85119b1/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:11.824269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.836452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c626d4-10b9-4e53-81fc-5c3fded2b1f9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:11.940323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:11.940955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:11.941236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:11.941768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:11.942519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:11.944345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043384-5bb7-4e96-8ea8-c7a9d97b47d7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:11.969746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 954/1906] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:11.974495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:11.990413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2543b-5af8-4dbd-8585-272dea21b821 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.001522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.002523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.002871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.003076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] PATH_INFO: `/v3/projects/58478a9630c94e5caa82a2fc398ab538/users/b0e02b52259643a59444b624b85119b1/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.005157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58478a9630c94e5caa82a2fc398ab538, user_id=b0e02b52259643a59444b624b85119b1, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.007903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.021697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 953/1907] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:11 2022] PUT /identity/v3/projects/58478a9630c94e5caa82a2fc398ab538/users/b0e02b52259643a59444b624b85119b1/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:12.032075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.032792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.033245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.060507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.062801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.100141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] MFA Rules not processed for user `b0e02b52259643a59444b624b85119b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:12.102457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.157685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ef878-5aa2-4692-840c-8336f37fb122 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.164578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.165709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.166116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.166409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] PATH_INFO: `/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.167801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715bf5ccbc284ca2bc6d0cdff0e91c5a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.170270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.197682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 955/1908] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:12.206876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.208390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.224167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715bf5ccbc284ca2bc6d0cdff0e91c5a', 'request_id': 'req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:12.231098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715bf5ccbc284ca2bc6d0cdff0e91c5a', 'request_id': 'req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:12.237785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715bf5ccbc284ca2bc6d0cdff0e91c5a', 'request_id': 'req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:12.252100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] The token cache is being invalidate because project 715bf5ccbc284ca2bc6d0cdff0e91c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:12.252621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:12.253274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6b55b7f7-48a0-487e-83d7-f82fafd5a8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:12.255094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 954/1909] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:12 2022] DELETE /identity/v3/projects/715bf5ccbc284ca2bc6d0cdff0e91c5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:12.259577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1041d6-bed9-4e81-a454-efb1ea0f4f0b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.259867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1041d6-bed9-4e81-a454-efb1ea0f4f0b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.260155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1041d6-bed9-4e81-a454-efb1ea0f4f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.271254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b79a41-8bb9-4e5f-853a-d4ceda2c29be None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.278396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0b1041d6-bed9-4e81-a454-efb1ea0f4f0b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:12.279602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0b1041d6-bed9-4e81-a454-efb1ea0f4f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.342111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.343443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.344229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.345851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.347803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 955/1910] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:12.348368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.355051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.355434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.356364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.378494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:12.379757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.397366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 956/1911] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:12.398606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.409353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f6de-dfc4-4cb5-b3b5-ecb6afd119bc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.414740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.415408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.415683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.415953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.416675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:12.417093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.418891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.424770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.426313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.438257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 956/1912] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:12.440139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 957/1913] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:12.445992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.457520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b3a7-8bcf-4207-953c-f256e418889f service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.463360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.464131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.464518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.465309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.466373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.469123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.501881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 957/1914] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:12.506327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.528867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e66af5-0233-4112-a370-6753bf4943b1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.615397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.616175 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.616720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.617453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.617851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.620271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.648628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 958/1915] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:12.650169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.667454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110377b-c99f-4187-93f3-e8e198437c3a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.677277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.677992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.678279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.678552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.679285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.680892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.716000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 958/1916] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:12.719979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.734130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67c57-5e8a-483d-82b6-0ba2aa55255e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.739347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.740250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.740697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.741074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.741927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.744010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2fb26-83d0-47d7-a936-e55302fb9f59 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.763385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 959/1917] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:12.764080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:12.774260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e9a6-a206-4d0a-8fb2-7c9cc4757624 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:12.780261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:12.781799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.782151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.782424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] PATH_INFO: `/v3/projects/882de24434ef4900a52dd877e497809f/users/15430281e19a4bb38f0134bc1ef705c1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.801363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882de24434ef4900a52dd877e497809f, user_id=15430281e19a4bb38f0134bc1ef705c1, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:12.804297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:12.824494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 959/1918] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:12 2022] PUT /identity/v3/projects/882de24434ef4900a52dd877e497809f/users/15430281e19a4bb38f0134bc1ef705c1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:12.842295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:12.843300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:12.843750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:12.898093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] MFA Rules not processed for user `15430281e19a4bb38f0134bc1ef705c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:12.899339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:12.992149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 960/1919] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:12.996444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.065272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74dcbd-25f2-45b5-bdc9-2f6c8ee98f06 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.070281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.070944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.071227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.071499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.072447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.074110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.105805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 960/1920] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:12 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:13.107088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.119177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8649-12cf-4150-b1aa-74913f232fd3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.204940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.206727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.206727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.206727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.207374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.209709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.251513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 961/1921] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:13 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:13.255360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.270926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37831-38b6-4382-b7d5-088c3737fc94 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.276453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.277128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.277409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.278925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.281215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.281863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.282931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.285151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.297837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4960f-2bd9-4a7c-9829-40f549c01a1e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.299008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 961/1922] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:13.303675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.307202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.308083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.308370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.308642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] PATH_INFO: `/v3/users/5992dfe48ae54b049df14a9701666ba2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.310041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5992dfe48ae54b049df14a9701666ba2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.311905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.333885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bf41-52d5-4cde-b283-2e611f048861 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.347840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.348759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.349071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.353986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] PATH_INFO: `/v3/projects/15263b80f0884f4f975bbbe3d4bac983/users/3957d3aa399c4657aacca6a59c4ac752/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.385238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15263b80f0884f4f975bbbe3d4bac983, user_id=3957d3aa399c4657aacca6a59c4ac752, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.387795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.389210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5992dfe48ae54b049df14a9701666ba2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:13.390625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5992dfe48ae54b049df14a9701666ba2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:13.391299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5992dfe48ae54b049df14a9701666ba2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:13.409449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5992dfe48ae54b049df14a9701666ba2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:13.418148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1e5608c9-2d86-45fc-b9ee-f95310411713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5992dfe48ae54b049df14a9701666ba2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:13.418756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 962/1923] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:13 2022] PUT /identity/v3/projects/15263b80f0884f4f975bbbe3d4bac983/users/3957d3aa399c4657aacca6a59c4ac752/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:13.424016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.431407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.438139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 962/1924] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:13 2022] DELETE /identity/v3/users/5992dfe48ae54b049df14a9701666ba2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:13.444117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.444587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.444911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.475612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:13.477391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.548175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28934cc5-b1c1-41d3-9fcf-b43d7f666f79 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.571131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 963/1925] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:13.572122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.582471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.634881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.636561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.636933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.637162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.637914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.639582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.652786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c14f9-50a2-4f64-ad39-6a0d213e9922 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.665424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.666258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.666458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.666706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.682366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 963/1926] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:13.686389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.687936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.689413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac28ac-e31a-4412-b0ec-f01786747bbd service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.702350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb85d62-102f-4b8e-b684-5eb97b83ade5 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.707392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.709103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.709421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.709655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] PATH_INFO: `/v3/projects/15263b80f0884f4f975bbbe3d4bac983/users/3957d3aa399c4657aacca6a59c4ac752/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.711977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15263b80f0884f4f975bbbe3d4bac983, user_id=3957d3aa399c4657aacca6a59c4ac752, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.715621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.718756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 964/1927] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:13.729512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 964/1928] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:13 2022] PUT /identity/v3/projects/15263b80f0884f4f975bbbe3d4bac983/users/3957d3aa399c4657aacca6a59c4ac752/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:13.739525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.739809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.740084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.780045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] MFA Rules not processed for user `3957d3aa399c4657aacca6a59c4ac752`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:13.781926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.866471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 965/1929] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:13.877944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:13.879722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:13.939706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc47892-eb70-4c71-800b-58c4a6e593b4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:13.943982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:13.944641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:13.944942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:13.945190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:13.955454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:13.956875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:13.966852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 965/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:14.077958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:14.089388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009dbaf-67fe-4a7d-9b7e-4463f85b8c02 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:14.094848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:14.095605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:14.095897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:14.096149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:14.098591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:14.164416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:14.169161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:14.209602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:14.210876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:14.221666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 966/1931] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:14.289947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9d8e-7c97-41a3-aa7e-7e8ce7c83d69 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:14.304835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:14.319413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:14.319706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:14.319990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] PATH_INFO: `/v3/projects/2b3aa3f652ea4d0ab0ee78ca173514c1` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:14.322999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3aa3f652ea4d0ab0ee78ca173514c1)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:14.330773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:14.415452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3aa3f652ea4d0ab0ee78ca173514c1', 'request_id': 'req-500120b2-3974-4548-ba62-bb5e74b9220f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.422055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3aa3f652ea4d0ab0ee78ca173514c1', 'request_id': 'req-500120b2-3974-4548-ba62-bb5e74b9220f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.428670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3aa3f652ea4d0ab0ee78ca173514c1', 'request_id': 'req-500120b2-3974-4548-ba62-bb5e74b9220f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.448446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] The token cache is being invalidate because project 2b3aa3f652ea4d0ab0ee78ca173514c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:14.448955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.449984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.453493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 966/1932] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:14 2022] DELETE /identity/v3/projects/2b3aa3f652ea4d0ab0ee78ca173514c1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:14.459478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:14.477235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dd0d-d502-480a-bb72-d6f441b20a76 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:14.597095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:14.598880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:14.599394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:14.599906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] PATH_INFO: `/v3/users/b0e02b52259643a59444b624b85119b1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:14.602275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e02b52259643a59444b624b85119b1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:14.606165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:14.741432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e02b52259643a59444b624b85119b1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.743877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e02b52259643a59444b624b85119b1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.747153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e02b52259643a59444b624b85119b1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.775147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e02b52259643a59444b624b85119b1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.791079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a46c512a-0976-4c83-8a62-8a83b5ca72ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e02b52259643a59444b624b85119b1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:14.819248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 967/1933] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:14 2022] DELETE /identity/v3/users/b0e02b52259643a59444b624b85119b1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:15.614829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:15.616279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:15.631715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500120b2-3974-4548-ba62-bb5e74b9220f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:15.689598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:15.690722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:15.690999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:15.691267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] PATH_INFO: `/v3/projects/58478a9630c94e5caa82a2fc398ab538` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:15.692548 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58478a9630c94e5caa82a2fc398ab538)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:15.694601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:15.742170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58478a9630c94e5caa82a2fc398ab538', 'request_id': 'req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:15.747346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58478a9630c94e5caa82a2fc398ab538', 'request_id': 'req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:15.753617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58478a9630c94e5caa82a2fc398ab538', 'request_id': 'req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:15.774519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] The token cache is being invalidate because project 58478a9630c94e5caa82a2fc398ab538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:15.774519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:15.774519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-32c497a5-3f07-4ec2-9c5e-e4a3afd9aa08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:15.774519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 967/1934] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:15 2022] DELETE /identity/v3/projects/58478a9630c94e5caa82a2fc398ab538 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:15.775603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:15.776058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:15.776222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:15.795540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:15.797670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:15.865037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 968/1935] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:15.874088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:15.874493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:15.874947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:15.893388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:15.894664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:15.902814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 968/1936] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:15.909021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:15.918940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8a140-40b7-4a3e-a80d-b2328ee31d70 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:15.924652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:15.925275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:15.925522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:15.925838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:15.926593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:15.926942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:15.929315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:15.948084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 969/1937] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:15.952969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:15.963253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f87107-b567-4184-aef7-a7d79a7dc34b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:15.969975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:15.970712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:15.971213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:15.971842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:15.972641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:15.974905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.036716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 969/1938] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:15 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:16.041704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.054665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce61a-7685-4c54-9ba3-a781af1425a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.124085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.124844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.125169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.125444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.126221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.128457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.150925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 970/1939] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:16.155008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.167087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71c31-1b51-4567-ba5d-aef2ed9fc094 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.174129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.174795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.175225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.175355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.176094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.177653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.189627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 970/1940] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:16.193981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.206448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cec22-128e-433a-9c27-56eb547f3f4f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.211253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.211922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.212236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.212513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.213237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.214878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc669942-0fce-446b-83ee-5c603207e7a5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.225514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 971/1941] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:16.229887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.241423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b4c6-199a-4c83-8561-0867af080359 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.246050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.246959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.247241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.247517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] PATH_INFO: `/v3/projects/86d80609d45b45b59377f310bccb965d/users/8a83ffe4ade4496db6b9fe0b54b8bdfa/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.261954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d80609d45b45b59377f310bccb965d, user_id=8a83ffe4ade4496db6b9fe0b54b8bdfa, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.265142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.277397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 971/1942] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:16 2022] PUT /identity/v3/projects/86d80609d45b45b59377f310bccb965d/users/8a83ffe4ade4496db6b9fe0b54b8bdfa/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:16.288732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.289020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.289323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.323836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] MFA Rules not processed for user `8a83ffe4ade4496db6b9fe0b54b8bdfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:16.325047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:16.407270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 972/1943] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:16.411883 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.488018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884c34a-9b1b-461f-bccc-0793fce8c23f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.501504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.502224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.502509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.502793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.503499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.505780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.538310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 972/1944] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:16.539607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.560411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87666-5105-4082-b2d2-47705ee75839 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.619577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.620284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.620583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.620838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.621545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.623626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.655892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 973/1945] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:16.660162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.672318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400051-b748-498c-ac87-633142ba5c32 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.677207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.678064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.678527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.678870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.679658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.681296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.696731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 973/1946] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:16.699005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.710621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1491a-ad4c-4279-ab10-7f03b79f686c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.723177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.723875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.724155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.724515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.725237 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.726887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd06956-b13b-4878-b9a7-7c03d80b1ff5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.741858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 974/1947] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:16.743106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.754012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bce0aa-19cc-4894-a701-2796d819ed58 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.759848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.761016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.761358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.761724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] PATH_INFO: `/v3/projects/06fd99b4593c42298f3a70a2e7427e78/users/82b1552f3a8d4830a9a43c2fb2f90ecd/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.779513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fd99b4593c42298f3a70a2e7427e78, user_id=82b1552f3a8d4830a9a43c2fb2f90ecd, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.783315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:16.803245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 974/1948] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:16 2022] PUT /identity/v3/projects/06fd99b4593c42298f3a70a2e7427e78/users/82b1552f3a8d4830a9a43c2fb2f90ecd/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:16.815374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.815811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.815983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.844040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] MFA Rules not processed for user `82b1552f3a8d4830a9a43c2fb2f90ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:16.845260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:16.909484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 975/1949] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:16.914015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:16.984584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff290e-a69a-47a4-b3af-93024f911fdd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:16.989237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:16.989923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:16.990208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:16.990484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:16.991178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:16.993060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.021625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 975/1950] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:17.023296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.034240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedab93-2237-4c8a-ab4f-02c22c1c307d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.089834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.090517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.090770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.091044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.091731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.093812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.115502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 976/1951] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:17 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:17.120741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.136251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f858c7-a786-4b52-84aa-04ca65bc1099 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.162995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.163673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.164013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.164618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.165352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.167006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.184395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 976/1952] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:17.186064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.204722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7c3c-c1a4-49e9-a21f-64f7d042c6a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.210609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.211585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.211938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.212663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] PATH_INFO: `/v3/projects/09ce7369134f4017b6751830d4c6ca01/users/8880fc5291c1440da68e592477316578/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.240340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ce7369134f4017b6751830d4c6ca01, user_id=8880fc5291c1440da68e592477316578, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.243075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.265455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 977/1953] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:17 2022] PUT /identity/v3/projects/09ce7369134f4017b6751830d4c6ca01/users/8880fc5291c1440da68e592477316578/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:17.270047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.289580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7127-c0ce-498d-8a07-539cc89d4b8f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.367157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.367895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.368185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.368461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.374729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.376392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc5883-6040-475f-bd60-d7264725c1a1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.388100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 977/1954] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:17.392288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.404522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f081e5-bde7-4b28-9134-fcaca6b306a8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.410799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.411691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.411972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.412246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] PATH_INFO: `/v3/projects/09ce7369134f4017b6751830d4c6ca01/users/8880fc5291c1440da68e592477316578/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.414302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ce7369134f4017b6751830d4c6ca01, user_id=8880fc5291c1440da68e592477316578, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.416928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.432249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 978/1955] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:17 2022] PUT /identity/v3/projects/09ce7369134f4017b6751830d4c6ca01/users/8880fc5291c1440da68e592477316578/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:17.442762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.443079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.443380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.477029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] MFA Rules not processed for user `8880fc5291c1440da68e592477316578`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:17.478600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:17.553097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 978/1956] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:17.564621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:17.566730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:17.633571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489e08-e3c1-46d8-9f09-801f7c9af97c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:17.638368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:17.639434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:17.640793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:17.640978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:17.710815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:17.712560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:17.723905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 979/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:19.648365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:19.650461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:19.667926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fdef5-f15b-4c71-8607-8571b1bddbb5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:19.675339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:19.676275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:19.676603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:19.676861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:19.749903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:19.751441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:19.760852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 979/1958] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:20.085106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:20.086618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.194498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16cbfc-8482-4ccc-8d68-205f8df16346 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:20.200846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:20.203152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.203152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.203658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] PATH_INFO: `/v3/users/15430281e19a4bb38f0134bc1ef705c1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.205342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15430281e19a4bb38f0134bc1ef705c1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:20.207458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:20.276421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15430281e19a4bb38f0134bc1ef705c1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.277591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15430281e19a4bb38f0134bc1ef705c1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.279104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15430281e19a4bb38f0134bc1ef705c1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.318356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15430281e19a4bb38f0134bc1ef705c1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.319575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:20.323264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.344225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cb6dec6f-fba5-41bd-8a18-de789bacac42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15430281e19a4bb38f0134bc1ef705c1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.346642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7314f1-4bb7-49dc-b63a-3ff052444033 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:20.352950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:20.353919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.354200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.354478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] PATH_INFO: `/v3/users/8171daaaafe74dac982435762d152bf3` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.355721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8171daaaafe74dac982435762d152bf3)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:20.357691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:20.360682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 980/1959] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:20 2022] DELETE /identity/v3/users/15430281e19a4bb38f0134bc1ef705c1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:20.364842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.365310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.370826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.397597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:20.399142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.425455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8171daaaafe74dac982435762d152bf3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.425455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8171daaaafe74dac982435762d152bf3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.425455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8171daaaafe74dac982435762d152bf3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.477296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8171daaaafe74dac982435762d152bf3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.486268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 981/1960] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:20.501478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:20.503465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.503857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8171daaaafe74dac982435762d152bf3'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:20.532544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 980/1961] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:20 2022] DELETE /identity/v3/users/8171daaaafe74dac982435762d152bf3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:20.624719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134dd3a-8bb7-4e3a-b596-81204fbaa082 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:20.650029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:20.651576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.718724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312d0d-723d-4f32-9675-a7ccdcdbc55c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:20.723449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:20.724226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.724429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:20.724703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.725147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.725683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.726102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.726520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.728748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.804722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:20.810098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:20.821446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:20.823404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:20.829626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 982/1962] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:20.830512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:20.832168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:20.844824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 981/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:20.855641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290020c-7846-463c-8cbd-88ca5d689571 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:20.861508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:20.862482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:20.862826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:20.863050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] PATH_INFO: `/v3/projects/c91e32f603f14660aea46cfc9a11a5ad` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:20.864286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91e32f603f14660aea46cfc9a11a5ad)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:20.866472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:20.981710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91e32f603f14660aea46cfc9a11a5ad', 'request_id': 'req-b8030ba9-ed47-4551-81d0-1f595382f17a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.006781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91e32f603f14660aea46cfc9a11a5ad', 'request_id': 'req-b8030ba9-ed47-4551-81d0-1f595382f17a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.031316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91e32f603f14660aea46cfc9a11a5ad', 'request_id': 'req-b8030ba9-ed47-4551-81d0-1f595382f17a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.069527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] The token cache is being invalidate because project c91e32f603f14660aea46cfc9a11a5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:21.070703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.071681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.076243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 983/1964] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:20 2022] DELETE /identity/v3/projects/c91e32f603f14660aea46cfc9a11a5ad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:21.078217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:21.098302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cbd1-4b41-4800-a438-457b5eba9b61 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:21.171719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:21.172605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.172885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.173163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] PATH_INFO: `/v3/users/e9ddf4183a534f1ab76894855f11dedb` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.174565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ddf4183a534f1ab76894855f11dedb)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:21.176647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:21.234468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:21.235985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:21.257026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030ba9-ed47-4551-81d0-1f595382f17a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:21.261259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ddf4183a534f1ab76894855f11dedb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.262109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ddf4183a534f1ab76894855f11dedb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.262796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ddf4183a534f1ab76894855f11dedb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.263701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:21.265091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.265589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.265955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] PATH_INFO: `/v3/projects/882de24434ef4900a52dd877e497809f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.268980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882de24434ef4900a52dd877e497809f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:21.279268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ddf4183a534f1ab76894855f11dedb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.281318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:21.294487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ddf4183a534f1ab76894855f11dedb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.315170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 982/1965] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:21 2022] DELETE /identity/v3/users/e9ddf4183a534f1ab76894855f11dedb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:21.352061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882de24434ef4900a52dd877e497809f', 'request_id': 'req-57ae6a64-cb2a-489a-93a5-ecc87c911343'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.358196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882de24434ef4900a52dd877e497809f', 'request_id': 'req-57ae6a64-cb2a-489a-93a5-ecc87c911343'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.367176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882de24434ef4900a52dd877e497809f', 'request_id': 'req-57ae6a64-cb2a-489a-93a5-ecc87c911343'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.388410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] The token cache is being invalidate because project 882de24434ef4900a52dd877e497809f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:21.388748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.390337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.393418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 984/1966] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:21 2022] DELETE /identity/v3/projects/882de24434ef4900a52dd877e497809f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:21.397451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:21.399324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:21.505344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdbfa-f2d9-4de2-b822-b28bf5e5d59a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:21.551368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:21.552402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:21.642007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:21.642741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.643023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.643295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] PATH_INFO: `/v3/users/3957d3aa399c4657aacca6a59c4ac752` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.644539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3957d3aa399c4657aacca6a59c4ac752)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:21.647400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:21.650336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6a64-cb2a-489a-93a5-ecc87c911343 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:21.657809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:21.658887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.659335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.659834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] PATH_INFO: `/v3/projects/4c2daac18d7945bab5adcc29b50e02fe` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.661185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2daac18d7945bab5adcc29b50e02fe)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:21.663551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:21.735692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2daac18d7945bab5adcc29b50e02fe', 'request_id': 'req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.744315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2daac18d7945bab5adcc29b50e02fe', 'request_id': 'req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.745528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3957d3aa399c4657aacca6a59c4ac752'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.746260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3957d3aa399c4657aacca6a59c4ac752'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.747571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3957d3aa399c4657aacca6a59c4ac752'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.756889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2daac18d7945bab5adcc29b50e02fe', 'request_id': 'req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.762438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3957d3aa399c4657aacca6a59c4ac752'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.776825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] The token cache is being invalidate because project 4c2daac18d7945bab5adcc29b50e02fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:21.777177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.778298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f12a0d01-c8db-4fbd-9c82-43ec059cfba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.784585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 985/1967] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:21 2022] DELETE /identity/v3/projects/4c2daac18d7945bab5adcc29b50e02fe => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:21.786261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-46a79315-d4dd-4938-b15c-d32bc8f48772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3957d3aa399c4657aacca6a59c4ac752'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:21.786499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.786789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.787111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.807642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:21.808496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 983/1968] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:21 2022] DELETE /identity/v3/users/3957d3aa399c4657aacca6a59c4ac752 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:21.809005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:21.905089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 986/1969] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:21.913320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.913862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.914300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.940950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:21.949929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:21.965968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 984/1970] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:21.970484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:21.981131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00313d6d-b47d-4d6a-8a97-187aa0c1dde8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:21.987000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:21.987573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:21.987854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:21.988123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:21.989370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:21.989632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:21.991252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.009728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 987/1971] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:57:22.013774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.023863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35523b-19cc-4543-b794-bab0bb94e07d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.028533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.029272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.029619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.029968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.030795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.032950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.069618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 985/1972] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:22.070396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.082323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdea68a-37e9-4687-bde2-08d7febde45a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.147052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.147796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.148085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.148362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.149105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.151066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.170333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.173149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:22.179583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 988/1973] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:22.183239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.188132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a9e7-31cf-4ee6-8ff9-0aefb0ad14fd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.194727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.195520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.195798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.196088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] PATH_INFO: `/v3/projects/15263b80f0884f4f975bbbe3d4bac983` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.196780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad115-5708-429c-8c5d-17be4464fbf4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.203541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.204420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.204854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.205115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.206158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.208045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.209338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15263b80f0884f4f975bbbe3d4bac983)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.211041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.225152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 989/1974] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:22.226623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.242109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2489c4-4ef0-4e8a-ad35-cf5fe77dc090 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.250066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.250795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.251092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.251395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.252404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.258944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.275236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 990/1975] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:22.276198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.277058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15263b80f0884f4f975bbbe3d4bac983', 'request_id': 'req-795edd77-be2c-430e-9c39-950b24181fc5'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:22.285431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15263b80f0884f4f975bbbe3d4bac983', 'request_id': 'req-795edd77-be2c-430e-9c39-950b24181fc5'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:22.287883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcdab4-548a-4174-8f4b-a2ea99459c4e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.292845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15263b80f0884f4f975bbbe3d4bac983', 'request_id': 'req-795edd77-be2c-430e-9c39-950b24181fc5'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:22.320895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] The token cache is being invalidate because project 15263b80f0884f4f975bbbe3d4bac983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:22.321499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:22.322844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-795edd77-be2c-430e-9c39-950b24181fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:22.327425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 986/1976] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:22 2022] DELETE /identity/v3/projects/15263b80f0884f4f975bbbe3d4bac983 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:22.334560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50189-6609-4373-8f60-b009337c2161 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.334855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50189-6609-4373-8f60-b009337c2161 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.335123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50189-6609-4373-8f60-b009337c2161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.359072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-dfc50189-6609-4373-8f60-b009337c2161 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:22.360449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dfc50189-6609-4373-8f60-b009337c2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:22.383934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.384978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.385262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.386397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] PATH_INFO: `/v3/projects/02bc8cb22fe34b4ab1ba6e94bbbf6091/users/d283cb6d199a40caa70fe314836d8d09/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.412114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc8cb22fe34b4ab1ba6e94bbbf6091, user_id=d283cb6d199a40caa70fe314836d8d09, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.414981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ad5b1-a442-4cc0-b681-bd5b86837df8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.445417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 991/1977] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:22 2022] PUT /identity/v3/projects/02bc8cb22fe34b4ab1ba6e94bbbf6091/users/d283cb6d199a40caa70fe314836d8d09/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:22.448988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 987/1978] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:22.457096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.457377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.457817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.460652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.460946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.461949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.497011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:22.499775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:22.501914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] MFA Rules not processed for user `d283cb6d199a40caa70fe314836d8d09`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:22.503250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:22.605597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 992/1979] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:22.610194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.619458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783465-56cd-4852-b089-d8d98dc1080f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.624807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.625638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 988/1980] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:22.625796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.625796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.626044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.626793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:22.627103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.628741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.630583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.632002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:22.641356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 993/1981] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:57:22.645674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.648430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039fb8e-2ed1-4a5b-bd6c-ad9ccda14037 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.653710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.654509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.654777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.655245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21733-bb2d-449a-af1b-c012b9464677 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.655400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.656581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.658744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.660138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.660791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.661076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.661681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.662069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.664005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.688626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 989/1982] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:22.692931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.697166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 994/1983] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:22.697843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.762435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431685-b0dc-447b-b30c-47817b5c2b09 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.774989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174932be-963d-46ab-8a7e-697f0e5e7934 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.779273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.780231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.780604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.780971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.781675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.783597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.821053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 995/1984] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:22.822653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.840173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.840857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.841133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.841404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.842132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.844070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.846318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a580f-da94-40c5-bae9-4d05885566dc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.852248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.853329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.853953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.854450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.855400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.857087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.865685 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 990/1985] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:22.868916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 996/1986] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:22.869280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.872487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.881280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303109a-65f4-4b09-be74-a20bde0b6dc6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.882959 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c655bc2-10fe-40fe-9915-5e3e7bd82c0d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.886136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.886868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.887213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.887553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.887655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.888276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.888398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.888551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.888825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.889579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.890600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.891290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.905853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 991/1987] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:22.906050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 997/1988] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:22.906139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.907844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.917545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881ccf7-6450-4582-9193-d3ca7d2a1820 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.917792 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f090e-5ec3-4f7e-b1bc-2a216ff74968 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:22.923120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.923362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:22.924117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.924242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.924469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.924581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.924742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] PATH_INFO: `/v3/projects/2ee8accc02d3447a8f46a082833ec6e9/users/c15af3c612e84ce48b91a7ecb002323c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.924845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] PATH_INFO: `/v3/projects/3532fd9760b748078fe3d7b31eb00c48/users/79fd77f35218489bae5bdd027bc5dcf2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:22.943024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee8accc02d3447a8f46a082833ec6e9, user_id=c15af3c612e84ce48b91a7ecb002323c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.945474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3532fd9760b748078fe3d7b31eb00c48, user_id=79fd77f35218489bae5bdd027bc5dcf2, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:22.945834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.948390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d1721-9b89-40ab-856e-3e67e967f527 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:22.963056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 992/1989] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:22 2022] PUT /identity/v3/projects/2ee8accc02d3447a8f46a082833ec6e9/users/c15af3c612e84ce48b91a7ecb002323c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:22.964195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:22.966713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 998/1990] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:22 2022] PUT /identity/v3/projects/3532fd9760b748078fe3d7b31eb00c48/users/79fd77f35218489bae5bdd027bc5dcf2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:22.977593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:22.978220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:22.978220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.006841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] MFA Rules not processed for user `79fd77f35218489bae5bdd027bc5dcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:23.008423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.028836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b4b8f-1bdf-4af0-8ae1-419817f56ee8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.083757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 999/1991] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:23.095864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.096680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.096953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:23.097374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.097794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.098639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.098762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.101076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.113563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 993/1992] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:23.117683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:23.129452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf01c1-8887-455c-b3ce-f8ce83e6089e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.134458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.135456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.135835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.136214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] PATH_INFO: `/v3/projects/2ee8accc02d3447a8f46a082833ec6e9/users/c15af3c612e84ce48b91a7ecb002323c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.139156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee8accc02d3447a8f46a082833ec6e9, user_id=c15af3c612e84ce48b91a7ecb002323c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.142315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f725eb0-d4d4-4287-90d0-6e6f12ab2bde admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.160430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 994/1993] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:23 2022] PUT /identity/v3/projects/2ee8accc02d3447a8f46a082833ec6e9/users/c15af3c612e84ce48b91a7ecb002323c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:23.165174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7400b-6a83-46ec-88ca-fe5535d7d34a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.170288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.171171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.171511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.200719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] MFA Rules not processed for user `c15af3c612e84ce48b91a7ecb002323c`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:23.202085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.225908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.226673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.227023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.227391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.278813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 995/1994] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:23.290375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:23.291901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.292107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.293557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.304270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1000/1995] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:23.305136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c1a94-f346-473b-a140-4bafb84a1f92 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.309240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.309933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.310489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.310777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.326567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:23.377489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.379208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c0856-9b05-4d15-a893-8e6a73320309 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.391523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 996/1996] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:23.395950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bcc89-37d0-461f-8214-9e30659dea35 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.400818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.401720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.402006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.402283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] PATH_INFO: `/v3/users/79fd77f35218489bae5bdd027bc5dcf2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.403918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fd77f35218489bae5bdd027bc5dcf2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.405740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.467389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fd77f35218489bae5bdd027bc5dcf2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:23.470153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fd77f35218489bae5bdd027bc5dcf2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:23.471307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fd77f35218489bae5bdd027bc5dcf2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:23.488396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fd77f35218489bae5bdd027bc5dcf2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:23.497482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fd77f35218489bae5bdd027bc5dcf2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:23.514571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1001/1997] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:23 2022] DELETE /identity/v3/users/79fd77f35218489bae5bdd027bc5dcf2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:23.518911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.519273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.519625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.538187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:23.539484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.631778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 997/1998] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:23.642899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:23.644316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:23.736860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949c73-9661-4a52-a5e4-f713e8675de2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:23.740733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:23.741445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:23.741827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:23.742183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:23.753891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:23.755433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce99f7-9bcc-4c36-93fa-55b81ca7c0aa service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:23.767739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1002/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:24.270935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.272418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:24.284337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ce6d-4af7-43f7-8146-90f670e9fb49 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.289303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.290254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.290553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.290826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] PATH_INFO: `/v3/projects/3532fd9760b748078fe3d7b31eb00c48` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.292046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3532fd9760b748078fe3d7b31eb00c48)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.293988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.343512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3532fd9760b748078fe3d7b31eb00c48', 'request_id': 'req-c1742d35-bf84-455e-b581-4e9de206c86e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:24.348894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3532fd9760b748078fe3d7b31eb00c48', 'request_id': 'req-c1742d35-bf84-455e-b581-4e9de206c86e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:24.354994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3532fd9760b748078fe3d7b31eb00c48', 'request_id': 'req-c1742d35-bf84-455e-b581-4e9de206c86e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:24.367435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] The token cache is being invalidate because project 3532fd9760b748078fe3d7b31eb00c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:24.367722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:24.368341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1742d35-bf84-455e-b581-4e9de206c86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:24.370316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 998/2000] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:24 2022] DELETE /identity/v3/projects/3532fd9760b748078fe3d7b31eb00c48 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:24.375689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.376208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.376292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.396133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:24.397344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:24.478875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1003/2001] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:24.487637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.487919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.488192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.507104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:24.508227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:24.516789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 999/2002] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:24.520963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.531174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874aed7-fa1e-44ba-be91-3d43c36f216f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.536615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.537280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.537560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.537863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.538620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:24.538879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.540498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.553501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1004/2003] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:57:24.557811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.568373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9469f0-3c11-4735-b960-ecc6ca3c9f05 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.573578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.574268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.574549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.574821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.575502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.577460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.606761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1000/2004] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:24 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:24.611626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.621576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ac09-9088-46cd-8563-4d19888088a5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.709948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.710628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.710912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.711186 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.711922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.714060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.736713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1005/2005] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:24 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:24.741056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.751972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cb66-0173-4e79-a2d7-14eae8a30feb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.758385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.759000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.759285 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.759571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.760298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.761920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.773692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1001/2006] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:24.777305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.788535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d787eee-e4d7-4420-a3b1-d78f50bb9746 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.793952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.794633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.794915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.795187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.796674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.798329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0679ed-9c16-48a4-b224-f3754cf84f89 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.809718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1006/2007] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:24.813846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:24.825011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39510-ac79-4117-9579-b6d34eea2540 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:24.830534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:24.831757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.832049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.832326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] PATH_INFO: `/v3/projects/dbc785ce6fac4c5a83f555d6b2c341b8/users/69f02b2d5c0c4a99a10ebf13bd4eda8b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.852061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc785ce6fac4c5a83f555d6b2c341b8, user_id=69f02b2d5c0c4a99a10ebf13bd4eda8b, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:24.854731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:24.873024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1002/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:24 2022] PUT /identity/v3/projects/dbc785ce6fac4c5a83f555d6b2c341b8/users/69f02b2d5c0c4a99a10ebf13bd4eda8b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:24.884517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:24.884891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:24.885227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:24.924486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] MFA Rules not processed for user `69f02b2d5c0c4a99a10ebf13bd4eda8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:24.926351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.026077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1007/2009] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:25.124654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:25.125995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.208223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1434b4-dad6-4a97-ba59-5f9b591e05be admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:25.215301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:25.216197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.216806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.217088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.228240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:25.229773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:25.253341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:25.256737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1003/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:25.305479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:25.307127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.373049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f809d8-42d5-43a4-a576-5dd2836fe4cd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:25.380170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:25.381200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.381526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.381867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] PATH_INFO: `/v3/users/69f02b2d5c0c4a99a10ebf13bd4eda8b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.383149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f02b2d5c0c4a99a10ebf13bd4eda8b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:25.385490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:25.401112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4f781-847c-4d2f-834f-5dc8b4b5ed29 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:25.408742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:25.410260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.410951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.410951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] PATH_INFO: `/v3/users/8a83ffe4ade4496db6b9fe0b54b8bdfa` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.412768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a83ffe4ade4496db6b9fe0b54b8bdfa)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:25.414609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:25.452836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f02b2d5c0c4a99a10ebf13bd4eda8b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.454012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f02b2d5c0c4a99a10ebf13bd4eda8b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.454720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f02b2d5c0c4a99a10ebf13bd4eda8b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.476763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f02b2d5c0c4a99a10ebf13bd4eda8b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.486941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ae1ec3b6-a61a-4b9a-aa4b-2f3abcc59690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f02b2d5c0c4a99a10ebf13bd4eda8b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.491206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a83ffe4ade4496db6b9fe0b54b8bdfa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.492086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a83ffe4ade4496db6b9fe0b54b8bdfa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.492716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a83ffe4ade4496db6b9fe0b54b8bdfa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.518902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1008/2011] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:25 2022] DELETE /identity/v3/users/69f02b2d5c0c4a99a10ebf13bd4eda8b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:25.523201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.524394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.524881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.525621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a83ffe4ade4496db6b9fe0b54b8bdfa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.543790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-cc1bbdd9-9262-4cfa-b0a4-574b024fceab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a83ffe4ade4496db6b9fe0b54b8bdfa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:25.557961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:25.559217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.571288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1004/2012] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:25 2022] DELETE /identity/v3/users/8a83ffe4ade4496db6b9fe0b54b8bdfa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:25.578199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.578595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.579532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.603845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:25.605556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.635953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1009/2013] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:25.650821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:25.652902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.673670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1005/2014] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:25.683092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:25.684463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:25.718111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc5e20-dcd5-4423-88c9-a621ac72cb5e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:25.748295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9868b-d43c-4f86-aed9-e5159c5fe5d3 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:25.752922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:25.753606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.753960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.754239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.766772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:25.768110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:25.778133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1006/2015] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:25.779305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:25.779995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:25.780282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:25.780559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:25.789890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:25.791335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:25.800813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1010/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:26.258217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.263308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.275725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c25da2-dce5-4f1e-9cd9-b0814d1b8b4e service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.282468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.283385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.283729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.284071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] PATH_INFO: `/v3/projects/86d80609d45b45b59377f310bccb965d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.285335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d80609d45b45b59377f310bccb965d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.287588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.307965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.310004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.348384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe625d3-02ea-4177-8902-660375673d8b service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.363360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d80609d45b45b59377f310bccb965d', 'request_id': 'req-6fd8bfdc-483d-49dd-8a50-7c00bc615992'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.368656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d80609d45b45b59377f310bccb965d', 'request_id': 'req-6fd8bfdc-483d-49dd-8a50-7c00bc615992'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.375372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d80609d45b45b59377f310bccb965d', 'request_id': 'req-6fd8bfdc-483d-49dd-8a50-7c00bc615992'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.390731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] The token cache is being invalidate because project 86d80609d45b45b59377f310bccb965d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:26.391011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.391798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.393996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1007/2017] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:26 2022] DELETE /identity/v3/projects/86d80609d45b45b59377f310bccb965d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:26.397594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.399167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.413364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.414415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.414676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.415116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] PATH_INFO: `/v3/projects/dbc785ce6fac4c5a83f555d6b2c341b8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.416468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc785ce6fac4c5a83f555d6b2c341b8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.418657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.474409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc785ce6fac4c5a83f555d6b2c341b8', 'request_id': 'req-ebe1cb8a-dd71-4eb5-9638-98627ead5542'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.481367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc785ce6fac4c5a83f555d6b2c341b8', 'request_id': 'req-ebe1cb8a-dd71-4eb5-9638-98627ead5542'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.485160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bfdc-483d-49dd-8a50-7c00bc615992 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.488411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc785ce6fac4c5a83f555d6b2c341b8', 'request_id': 'req-ebe1cb8a-dd71-4eb5-9638-98627ead5542'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.502799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] The token cache is being invalidate because project dbc785ce6fac4c5a83f555d6b2c341b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:26.503257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.504101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ebe1cb8a-dd71-4eb5-9638-98627ead5542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.505843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1011/2018] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:26 2022] DELETE /identity/v3/projects/dbc785ce6fac4c5a83f555d6b2c341b8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:26.510658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099b4c-41a0-4029-89b7-51b106da8000 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.510940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099b4c-41a0-4029-89b7-51b106da8000 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.511292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099b4c-41a0-4029-89b7-51b106da8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.531715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3e099b4c-41a0-4029-89b7-51b106da8000 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:26.533031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3e099b4c-41a0-4029-89b7-51b106da8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.548227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.549192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.549593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.550131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] PATH_INFO: `/v3/users/82b1552f3a8d4830a9a43c2fb2f90ecd` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.557824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b1552f3a8d4830a9a43c2fb2f90ecd)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.560047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.600885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1012/2019] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:26.610420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.610941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.611284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.631737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b1552f3a8d4830a9a43c2fb2f90ecd'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.632599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:26.632839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b1552f3a8d4830a9a43c2fb2f90ecd'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.633679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b1552f3a8d4830a9a43c2fb2f90ecd'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.633970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.642750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1013/2020] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:26.647286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b1552f3a8d4830a9a43c2fb2f90ecd'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.648777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.655274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b1552f3a8d4830a9a43c2fb2f90ecd'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:26.665441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a52a8-5754-4358-8013-805992e76a5a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.665441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.665441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.665441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.665830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.665830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:26.665991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.667639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.670960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1008/2021] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:26 2022] DELETE /identity/v3/users/82b1552f3a8d4830a9a43c2fb2f90ecd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:26.684193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1014/2022] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:26.689232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.756616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133cfc-fa02-4fde-8934-fed6562e3639 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.761488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.762187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.762471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.762749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.763443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.765712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.792605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1009/2023] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:26 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:26.797917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.810303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb596a3-e5ca-4868-9a07-488ce7793258 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.882137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.883551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.884008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.884395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.885830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.887970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.909432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1015/2024] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:26 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:26.914007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.928140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555c9f4-e960-4586-ab91-51fc0a9c3488 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.934900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.935918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.937426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.937937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.938927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.941048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:26.956888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1010/2025] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:26.958168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.973406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:26.974954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131640f-b5b2-43b6-9e5c-2c7f9d013faa admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:26.975933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:26.985978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:26.989020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:26.989372 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:26.989827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:26.990711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:26.994232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.006813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db96-bdd8-4108-a93c-c50eada8c585 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.016984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1016/2026] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:27.016984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.022941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.023937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.024708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.025060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] PATH_INFO: `/v3/projects/06fd99b4593c42298f3a70a2e7427e78` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.026945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fd99b4593c42298f3a70a2e7427e78)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.029351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.032199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718e2d-f17c-40c0-b44b-7127616d894f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.037497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.038802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.038802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.038998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] PATH_INFO: `/v3/projects/bc60d687694c4e56812e020e6d382253/users/30769e53979246e48278a97b3fd4fb60/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.054697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc60d687694c4e56812e020e6d382253, user_id=30769e53979246e48278a97b3fd4fb60, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.057355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f6492-84ab-4331-8797-23ced55f4fd8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.071028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1017/2027] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:27 2022] PUT /identity/v3/projects/bc60d687694c4e56812e020e6d382253/users/30769e53979246e48278a97b3fd4fb60/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:27.080798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fd99b4593c42298f3a70a2e7427e78', 'request_id': 'req-a8030a96-2a23-42cf-b696-e24aa59336aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.081415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.081805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.082144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.086330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fd99b4593c42298f3a70a2e7427e78', 'request_id': 'req-a8030a96-2a23-42cf-b696-e24aa59336aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.093152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fd99b4593c42298f3a70a2e7427e78', 'request_id': 'req-a8030a96-2a23-42cf-b696-e24aa59336aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.105592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] The token cache is being invalidate because project 06fd99b4593c42298f3a70a2e7427e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:27.105919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.106569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.108695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1011/2028] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:26 2022] DELETE /identity/v3/projects/06fd99b4593c42298f3a70a2e7427e78 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:27.110430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] MFA Rules not processed for user `30769e53979246e48278a97b3fd4fb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:27.111839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.112654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.113704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.181337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8030a96-2a23-42cf-b696-e24aa59336aa admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.186268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.187168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.187449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.187823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] PATH_INFO: `/v3/users/8880fc5291c1440da68e592477316578` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.189052 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8880fc5291c1440da68e592477316578)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.191298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.198105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1018/2029] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:27.199114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.203162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.216477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87b08-3e67-4926-bd7d-a6db9fbfc422 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.223003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.223745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.224062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.224309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.225142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.227179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.244801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8880fc5291c1440da68e592477316578'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.245485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8880fc5291c1440da68e592477316578'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.246175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8880fc5291c1440da68e592477316578'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.257894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1019/2030] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:27.259769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8880fc5291c1440da68e592477316578'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.261420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.263439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.267588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8880fc5291c1440da68e592477316578'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.287589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1012/2031] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:27 2022] DELETE /identity/v3/users/8880fc5291c1440da68e592477316578 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:27.332787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2dcd-794b-4720-a376-8eed236d2734 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.392622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.393307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.393593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.393899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.394594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.396634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.419336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1020/2032] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:27.423605 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.434362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958919-8494-458c-817c-1e2ea928444e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.441938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.442621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.443029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.444068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.444808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.446521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.457785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1013/2033] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:27.462918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.473606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823d81-2e1d-404b-83e4-50894ce580ae admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.478675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.479350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.479626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.479899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.480627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.482260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986b7da-598e-41b9-9ff7-3425cfa90452 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.492508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1021/2034] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:27.496568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.507016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9d4c-95f5-4a93-ace9-ec5d957c6e2c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.511885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.512788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.513069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.513348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] PATH_INFO: `/v3/projects/0e272556c5a7402190265b17fb9b6719/users/57a90fa1c5fa4c83a5a99203b8fc1257/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.528693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e272556c5a7402190265b17fb9b6719, user_id=57a90fa1c5fa4c83a5a99203b8fc1257, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.532264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.546614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1014/2035] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:27 2022] PUT /identity/v3/projects/0e272556c5a7402190265b17fb9b6719/users/57a90fa1c5fa4c83a5a99203b8fc1257/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:27.557833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.558050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.558512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.575763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.578572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.591468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] MFA Rules not processed for user `57a90fa1c5fa4c83a5a99203b8fc1257`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:27.593934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.659364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d355acd-56a8-45a4-bb47-f59084f40689 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.664312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.665176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.665466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.665763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] PATH_INFO: `/v3/projects/09ce7369134f4017b6751830d4c6ca01` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.667029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ce7369134f4017b6751830d4c6ca01)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.668927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.683239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1022/2036] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:27.684168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.685494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.699604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6590-eb75-4f81-be37-bb3c258616ce None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.706303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.706962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.707246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.707518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] PATH_INFO: `/v3/users/cb60e886813547c28884322cfb075072` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.708856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb60e886813547c28884322cfb075072)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.710916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.723302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ce7369134f4017b6751830d4c6ca01', 'request_id': 'req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.730383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ce7369134f4017b6751830d4c6ca01', 'request_id': 'req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.737025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ce7369134f4017b6751830d4c6ca01', 'request_id': 'req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.750222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] The token cache is being invalidate because project 09ce7369134f4017b6751830d4c6ca01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:27.750652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.751276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.765725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1015/2037] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:27 2022] DELETE /identity/v3/projects/09ce7369134f4017b6751830d4c6ca01 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:27.765725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.765725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.766135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb60e886813547c28884322cfb075072'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.766135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb60e886813547c28884322cfb075072'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.766135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb60e886813547c28884322cfb075072'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.776657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb60e886813547c28884322cfb075072'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.788038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2d27a283-63c5-451a-9c1d-ef2953c7bd80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb60e886813547c28884322cfb075072'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:27.802580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1023/2038] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:27 2022] DELETE /identity/v3/users/cb60e886813547c28884322cfb075072 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:27.807177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.807476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.807756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.829338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:27.830541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.838012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8af6-b748-4ff6-bc69-90a2914b5ec4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:27.895996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1024/2039] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:27.902354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:27.903152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:27.903537 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:27.903916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:27.904759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:27.907107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:27.907265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.908805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.938255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1016/2040] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:27.942732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:27.944997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:27.975540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c9833-243f-4f49-a02f-9fca559d579f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.008089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b828-fd72-40f5-8a8c-04f081261517 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.012754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.013415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.013720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.013997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.015283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.017198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.022732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.023429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.023705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.023978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.034634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.036050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.041088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1017/2041] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:27 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:28.042653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.047150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1025/2042] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:28.052739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc84e1-ae67-4fda-96bc-00362d54e9f9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.058157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.058826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.059125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.059373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.060232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.062364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.075840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1018/2043] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:28.080434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.090312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5e43-3afe-48c2-943c-fa5c2e38736d service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.095955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.096867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.097129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.097404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] PATH_INFO: `/v3/projects/dbd55c9a7f0d4116bd24d336776900c8/users/5ebe56b2424441e1a65d3028ef66ff85/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.116401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd55c9a7f0d4116bd24d336776900c8, user_id=5ebe56b2424441e1a65d3028ef66ff85, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.129144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.133494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1026/2044] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:28 2022] PUT /identity/v3/projects/dbd55c9a7f0d4116bd24d336776900c8/users/5ebe56b2424441e1a65d3028ef66ff85/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:28.137609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.144482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.146921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.150792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529422-d514-490b-b55c-ae7b030dadf1 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.209179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebac0d1-f695-4905-a6d7-80436eb21c8a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.213204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.213971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.214337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.214709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.216865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.260045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.260953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.261905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.262353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.263214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.264976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.280895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1019/2045] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:28.282623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.288199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.289624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1c6a-427a-4b52-8d36-f5070ed8687a service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.295067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c7537-c721-4a3b-b62a-f264ea6bc757 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.300093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1027/2046] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:28.301785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.302676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.302967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.303240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] PATH_INFO: `/v3/projects/dbd55c9a7f0d4116bd24d336776900c8/users/5ebe56b2424441e1a65d3028ef66ff85/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.305321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd55c9a7f0d4116bd24d336776900c8, user_id=5ebe56b2424441e1a65d3028ef66ff85, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.308115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.323068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1020/2047] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:28 2022] PUT /identity/v3/projects/dbd55c9a7f0d4116bd24d336776900c8/users/5ebe56b2424441e1a65d3028ef66ff85/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:28.334751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.335207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.339248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.371621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] MFA Rules not processed for user `5ebe56b2424441e1a65d3028ef66ff85`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:28.371747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.372915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.375181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.497186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063967d6-d0c6-48f8-9b5c-2edd5e13cf8e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.505409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1028/2048] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:28.509457 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.510461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.510811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.511150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] PATH_INFO: `/v3/projects/52350670b4a94b3e8261911eac64ab5e` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.512475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52350670b4a94b3e8261911eac64ab5e)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.514261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.516488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.518968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.587722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8bc18-80c9-4aef-849f-ddf6a40dd970 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.594831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.595567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.595917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.596301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.598466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.607204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52350670b4a94b3e8261911eac64ab5e', 'request_id': 'req-b46aa1f9-fea8-436e-bc3d-a821c06be03e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:28.614146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52350670b4a94b3e8261911eac64ab5e', 'request_id': 'req-b46aa1f9-fea8-436e-bc3d-a821c06be03e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:28.620810 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52350670b4a94b3e8261911eac64ab5e', 'request_id': 'req-b46aa1f9-fea8-436e-bc3d-a821c06be03e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:28.657984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] The token cache is being invalidate because project 52350670b4a94b3e8261911eac64ab5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:28.658287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:28.658966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b46aa1f9-fea8-436e-bc3d-a821c06be03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:28.660674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1021/2049] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:28 2022] DELETE /identity/v3/projects/52350670b4a94b3e8261911eac64ab5e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:28.665888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.666174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.666449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.678462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.679894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe07c62-4b3a-44d6-a444-ffb559971659 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.691953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1029/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:28.702328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:28.703704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.784263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1022/2051] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:28.794257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.794257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.794497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.817344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:28.818671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:28.827079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1030/2052] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:28.831426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.841227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12898ea-e7b1-4c42-97bf-2af7caa74639 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.847859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.848522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.848808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.849084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.849843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:28.850156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.852071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.868945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1023/2053] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:28.870151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.881026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366f96a-8d94-4a4f-a1ad-831e35822c29 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.886067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.886715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.886993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.887262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.887947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:28.890609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:28.917056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1031/2054] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:28.921510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:28.931604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ffe2-3fb6-479a-9ca4-890b52501373 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:28.997192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:28.998008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:28.998292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:28.998570 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:28.999312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.001217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.024144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1024/2055] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:28 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:29.028106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.039155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7976e3c-5d35-4a47-b626-e4a4c6a932b7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.044026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.044701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.045068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.045375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.046257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.048032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.060605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1032/2056] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:29.064595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.078606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53b7d4-8bf1-4918-a33b-4b867f415e80 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.083328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.083991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.084301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.084577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.085295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.086929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac110f-c0c5-4f34-a614-d93e87178b0c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.098582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1025/2057] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:29.102574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.115341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920436-2776-4855-b17c-7804ad034d4b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.119972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.121026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.121305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.121571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] PATH_INFO: `/v3/projects/5d3f8d628ee24b7795b81697e4d9c346/users/9ced7c148493466aacf1ceb26743dee8/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.136100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3f8d628ee24b7795b81697e4d9c346, user_id=9ced7c148493466aacf1ceb26743dee8, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.138788 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.152326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1033/2058] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:29 2022] PUT /identity/v3/projects/5d3f8d628ee24b7795b81697e4d9c346/users/9ced7c148493466aacf1ceb26743dee8/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:29.163435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.163744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.164044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.189087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] MFA Rules not processed for user `9ced7c148493466aacf1ceb26743dee8`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:29.190635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:29.254943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1026/2059] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:29.259978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.323231 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360660-615c-4bd1-b66a-4861be1eae0e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.329732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.330403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.330679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.330947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.331633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.333512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.364624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1034/2060] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:29 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:29.368714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.381522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08af44-47b3-4d23-8104-ca9ff029568c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.450083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.450779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.451076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.451452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.452921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.454856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.490013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1027/2061] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:29 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:29.494669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.510001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fd67-0f5a-45a4-bf30-ed39a57d6978 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.515515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.516167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.516443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.516710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.517421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.519039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.530507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1035/2062] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:29.534761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.544892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abe89-861b-4059-8616-300aab316668 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.549895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.550867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.551149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.551419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] PATH_INFO: `/v3/projects/c670b2f8b3c94fe593cc2621e137c462/users/34f2f78efd824fa5aba06395e2d04803/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.567430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c670b2f8b3c94fe593cc2621e137c462, user_id=34f2f78efd824fa5aba06395e2d04803, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.569845 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.594378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1028/2063] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:29 2022] PUT /identity/v3/projects/c670b2f8b3c94fe593cc2621e137c462/users/34f2f78efd824fa5aba06395e2d04803/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:29.599559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.616281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59edd02-7e4e-4b93-bd58-6b18ef672e5f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.684283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.685016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.685303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.685612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.687559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.689151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4f90-c26b-4442-ab0c-1a3901942019 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.702641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1036/2064] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:29.703798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.713971 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421c4-4ed1-419f-9fa8-73d6ea97d330 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.719378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.720251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.720527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.720801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] PATH_INFO: `/v3/projects/c670b2f8b3c94fe593cc2621e137c462/users/34f2f78efd824fa5aba06395e2d04803/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.722775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c670b2f8b3c94fe593cc2621e137c462, user_id=34f2f78efd824fa5aba06395e2d04803, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.725402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:29.737127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1029/2065] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:29 2022] PUT /identity/v3/projects/c670b2f8b3c94fe593cc2621e137c462/users/34f2f78efd824fa5aba06395e2d04803/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:29.747307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.747618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.747886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.775335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] MFA Rules not processed for user `34f2f78efd824fa5aba06395e2d04803`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:29.776530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:29.848309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1037/2066] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:29.860219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:29.861965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:29.918545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e6c5-275f-4932-a786-3f06ccd4bfda admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:29.923571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:29.924217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:29.924496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:29.924770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:29.988866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:29.990582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:30.000196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1030/2067] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:30.262135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:30.263420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:30.275615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1b157-a023-4276-b6ce-1990e66303e1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:30.279330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:30.281078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:30.281371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:30.281677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:30.283996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:30.346697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:30.348147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:30.357353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1038/2068] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:31.053153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:31.062137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee348b-f4ed-41af-828a-75c3a5fec002 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:31.066122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:31.066795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:31.067031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:31.067305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:31.069126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:31.136759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:31.138352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6139d-58c9-4bd1-81ed-7c36d4876ad9 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:31.149280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1031/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:32.531635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:32.611824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d900c4-16df-4749-9b74-a6ee682a6854 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:32.617008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:32.617981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:32.618338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:32.618662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] PATH_INFO: `/v3/users/9ced7c148493466aacf1ceb26743dee8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:32.619820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ced7c148493466aacf1ceb26743dee8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:32.622041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:32.675126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ced7c148493466aacf1ceb26743dee8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:32.676127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ced7c148493466aacf1ceb26743dee8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:32.676568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ced7c148493466aacf1ceb26743dee8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:32.689561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ced7c148493466aacf1ceb26743dee8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:32.698745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ced7c148493466aacf1ceb26743dee8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:32.711648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1039/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:32 2022] DELETE /identity/v3/users/9ced7c148493466aacf1ceb26743dee8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:32.716576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:32.717079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:32.717761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:32.736142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:32.737337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:32.797475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1032/2071] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:32.807925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:32.808923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:32.868167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df78e-60be-4374-aac7-fb679fa5a624 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:32.871838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:32.872482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:32.872761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:32.873038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:32.884802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:32.886796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:32.899815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1040/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:33.204324 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:33.205773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:33.219848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d72a5c-328b-407e-8431-5ccc6c5fab2a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:33.224456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:33.225374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.225889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.225889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] PATH_INFO: `/v3/projects/5d3f8d628ee24b7795b81697e4d9c346` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.227049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3f8d628ee24b7795b81697e4d9c346)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:33.228946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:33.280987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3f8d628ee24b7795b81697e4d9c346', 'request_id': 'req-5e2e0dad-0b04-46e9-b181-03588195c34f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.286765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3f8d628ee24b7795b81697e4d9c346', 'request_id': 'req-5e2e0dad-0b04-46e9-b181-03588195c34f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.293185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3f8d628ee24b7795b81697e4d9c346', 'request_id': 'req-5e2e0dad-0b04-46e9-b181-03588195c34f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.308111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] The token cache is being invalidate because project 5d3f8d628ee24b7795b81697e4d9c346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:33.308536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.309375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.312518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1033/2073] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:33 2022] DELETE /identity/v3/projects/5d3f8d628ee24b7795b81697e4d9c346 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:33.316824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:33.327177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb43f4-e649-4ca2-b7aa-6036dc927b8a service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:33.355878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:33.357339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:33.395402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:33.396375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.396729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.397052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] PATH_INFO: `/v3/users/34f2f78efd824fa5aba06395e2d04803` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.398382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f2f78efd824fa5aba06395e2d04803)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:33.400406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:33.429572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0dad-0b04-46e9-b181-03588195c34f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:33.435424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:33.437635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.437635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.437635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] PATH_INFO: `/v3/users/d283cb6d199a40caa70fe314836d8d09` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.439012 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d283cb6d199a40caa70fe314836d8d09)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:33.441442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:33.456914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f2f78efd824fa5aba06395e2d04803'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.457852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f2f78efd824fa5aba06395e2d04803'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.458568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f2f78efd824fa5aba06395e2d04803'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.470925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f2f78efd824fa5aba06395e2d04803'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.478947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a242a5c-4b5c-4ebe-9c2c-bc6daf1495a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f2f78efd824fa5aba06395e2d04803'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.493285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1041/2074] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:33 2022] DELETE /identity/v3/users/34f2f78efd824fa5aba06395e2d04803 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:33.497818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd283cb6d199a40caa70fe314836d8d09'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.499954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd283cb6d199a40caa70fe314836d8d09'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.500625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd283cb6d199a40caa70fe314836d8d09'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.513754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd283cb6d199a40caa70fe314836d8d09'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.521426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd283cb6d199a40caa70fe314836d8d09'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.534763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1034/2075] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:33 2022] DELETE /identity/v3/users/d283cb6d199a40caa70fe314836d8d09 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:33.539060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.539569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.539649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.558967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:33.560197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:33.622551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1042/2076] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:33.633090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:33.634574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:33.702507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf16d-f2a5-4661-9276-3e11899b8385 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:33.706564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:33.707246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.707529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.707806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.718629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:33.720068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a06720-9f9a-4cb0-873a-b6b108692340 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:33.730708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1035/2077] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:33.853393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:33.854879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:33.868036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0733aa-d487-4c5f-b7e0-8caab48bea4c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:33.875099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:33.875854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.876192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.876397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] PATH_INFO: `/v3/projects/c670b2f8b3c94fe593cc2621e137c462` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:33.877694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c670b2f8b3c94fe593cc2621e137c462)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:33.879626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:33.938000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c670b2f8b3c94fe593cc2621e137c462', 'request_id': 'req-7b201454-252a-43c1-8259-10b8b55d2adc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.945429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c670b2f8b3c94fe593cc2621e137c462', 'request_id': 'req-7b201454-252a-43c1-8259-10b8b55d2adc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.953083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c670b2f8b3c94fe593cc2621e137c462', 'request_id': 'req-7b201454-252a-43c1-8259-10b8b55d2adc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.985262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] The token cache is being invalidate because project c670b2f8b3c94fe593cc2621e137c462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:33.986105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.987864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b201454-252a-43c1-8259-10b8b55d2adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:33.989574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1043/2078] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:33 2022] DELETE /identity/v3/projects/c670b2f8b3c94fe593cc2621e137c462 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:33.995103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:33.995648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:33.996152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.019832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:34.021218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.105521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1036/2079] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:34.116121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.116121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.116483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.123154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.125474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.139831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89ee85-34ce-400e-908c-980c35d9d090 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.142433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:34.143856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.147044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.148063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.148351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.148620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] PATH_INFO: `/v3/projects/02bc8cb22fe34b4ab1ba6e94bbbf6091` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.149982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bc8cb22fe34b4ab1ba6e94bbbf6091)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.152849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1044/2080] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:34.154168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.157475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.167395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8e676-aae0-4d99-a84b-8cb656756c06 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.172969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.173624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.173934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.174205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.174931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:34.175235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.176870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.192198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1045/2081] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:34.196429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.207260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d478d35-6288-4646-814b-dbd0664b1ec4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.208979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bc8cb22fe34b4ab1ba6e94bbbf6091', 'request_id': 'req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.216151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bc8cb22fe34b4ab1ba6e94bbbf6091', 'request_id': 'req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.222928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bc8cb22fe34b4ab1ba6e94bbbf6091', 'request_id': 'req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.242125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] The token cache is being invalidate because project 02bc8cb22fe34b4ab1ba6e94bbbf6091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:34.242547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.243518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.245435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1037/2082] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:34 2022] DELETE /identity/v3/projects/02bc8cb22fe34b4ab1ba6e94bbbf6091 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:34.249479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.251229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.275305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.276107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.276408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.276686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.277400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.280493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.313585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1046/2083] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:34.315341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.317305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.328351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a7a1-daf0-4c0f-8dd5-4fc328dd6961 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.394827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4117-ca62-45be-8c67-829886894c6f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.400280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.400964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.401242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.401669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.402370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.404330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.406392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.407357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.407798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.408074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] PATH_INFO: `/v3/users/c15af3c612e84ce48b91a7ecb002323c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.409554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15af3c612e84ce48b91a7ecb002323c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.411632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.446857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1047/2084] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:34 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:34.451843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.464102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734078-544d-4360-8a18-434a1dd9aab2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.469473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15af3c612e84ce48b91a7ecb002323c'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.470252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15af3c612e84ce48b91a7ecb002323c'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.470897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15af3c612e84ce48b91a7ecb002323c'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.471269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.472088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.473785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.475304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.476249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.477997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.488204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15af3c612e84ce48b91a7ecb002323c'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.489319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1048/2085] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:34.493512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.497697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.501045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15af3c612e84ce48b91a7ecb002323c'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.512415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb209d1-3f77-4882-9e46-8ae8341f7f68 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.518638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1038/2086] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:34 2022] DELETE /identity/v3/users/c15af3c612e84ce48b91a7ecb002323c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:34.518920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.520108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.520392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.520667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.521610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.523242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2ac3-87dd-4fbf-8019-3148a9135546 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.538754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1049/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:34.542954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.619783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6b3ea-2149-432a-871d-d095f22889cd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.625400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.626383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.626729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.626988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] PATH_INFO: `/v3/projects/4bd45432c89947d68353fb8c010551f6/users/5e4b7ca3d4f04848ba50347f57ab3684/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.642878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd45432c89947d68353fb8c010551f6, user_id=5e4b7ca3d4f04848ba50347f57ab3684, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.645546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.658418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1039/2088] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:34 2022] PUT /identity/v3/projects/4bd45432c89947d68353fb8c010551f6/users/5e4b7ca3d4f04848ba50347f57ab3684/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:34.668736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.669579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.669900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.704109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] MFA Rules not processed for user `5e4b7ca3d4f04848ba50347f57ab3684`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:34.705506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.773103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1050/2089] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:34.785384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.789386 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.809702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:34.811774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:34.865105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdedd-2035-4573-bc41-b73be493b218 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.868615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.869254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.869534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.869846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.878358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.879779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83bf2-5593-4c92-83e4-c3cf5064e871 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.888388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1040/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:34.892853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26f49-7bd8-4ed2-b890-d2aa326c34dd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:34.897593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:34.898478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.898762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.899065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] PATH_INFO: `/v3/projects/2ee8accc02d3447a8f46a082833ec6e9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:34.900259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee8accc02d3447a8f46a082833ec6e9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:34.902163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:34.949619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee8accc02d3447a8f46a082833ec6e9', 'request_id': 'req-012a9ab9-4d0c-4932-ad70-4cd4b791420a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.955143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee8accc02d3447a8f46a082833ec6e9', 'request_id': 'req-012a9ab9-4d0c-4932-ad70-4cd4b791420a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.961076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee8accc02d3447a8f46a082833ec6e9', 'request_id': 'req-012a9ab9-4d0c-4932-ad70-4cd4b791420a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.974961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] The token cache is being invalidate because project 2ee8accc02d3447a8f46a082833ec6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:34.975246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.975875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-012a9ab9-4d0c-4932-ad70-4cd4b791420a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:34.977425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1051/2091] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:34 2022] DELETE /identity/v3/projects/2ee8accc02d3447a8f46a082833ec6e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:34.983916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:34.984214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:34.984494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.002471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:35.003668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.067380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1041/2092] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:35.076729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.077019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.077288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.099942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:35.101450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.115682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1052/2093] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:35.120201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.135280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c409fb-4f31-4b0d-b9ca-679c1f640a4d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.143361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.144724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.145252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.145775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.146708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:35.146983 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.148649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.168198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1042/2094] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:35.168833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.179560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a55635-82a1-4ca3-b459-5547ad796c12 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.180410 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.183352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.184978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.186474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.187003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.187429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.188264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.190712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.198153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9103-9f7f-488c-8093-cac4a1b427a9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.204031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.205182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.205463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.205766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] PATH_INFO: `/v3/users/30769e53979246e48278a97b3fd4fb60` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.207652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30769e53979246e48278a97b3fd4fb60)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.210824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.231452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1053/2095] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:35.235760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.263903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30769e53979246e48278a97b3fd4fb60'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:35.264589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30769e53979246e48278a97b3fd4fb60'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:35.265231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30769e53979246e48278a97b3fd4fb60'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:35.277087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30769e53979246e48278a97b3fd4fb60'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:35.285533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a2bc4534-1f9c-4217-ba92-6ec70e5a313d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30769e53979246e48278a97b3fd4fb60'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:35.297990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1043/2096] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:35 2022] DELETE /identity/v3/users/30769e53979246e48278a97b3fd4fb60 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:35.302341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.302629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.302906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.303653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d589-53cc-4e60-b09f-62212fb5475b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.319796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:35.321019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.359930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.360778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.361123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.361466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.362246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.364244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.380817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1044/2097] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:35.389826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1054/2098] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:35 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:57:35.390993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.391890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.392431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.393450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.404992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f68a79-db44-4476-84da-ba8957c5ee75 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.410145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.410798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.411075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.411353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.412072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.413669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.424670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1045/2099] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:35.432280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.442516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87881-04a5-4b02-852e-842080f99e8e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.447156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.447805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.448091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.448366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.449080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.450694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.451982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61893490-0ed0-43dd-951a-14edf811cfc7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.455801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.456441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.456718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.456993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.460776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1046/2100] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:35.464884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.466301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.468638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753d6ac-57a1-4898-aae1-b2e20f59e4f2 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.474934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbab84-e993-4023-ae0b-16bdbc130782 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.478161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1055/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:35.479898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.480770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.481055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.481330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] PATH_INFO: `/v3/projects/ca751f0c36b2497d9b5a782a6082505b/users/a94970e1593640a2ad24f57b4b337b1a/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.497070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca751f0c36b2497d9b5a782a6082505b, user_id=a94970e1593640a2ad24f57b4b337b1a, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.499934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.512704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1047/2102] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:35 2022] PUT /identity/v3/projects/ca751f0c36b2497d9b5a782a6082505b/users/a94970e1593640a2ad24f57b4b337b1a/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:35.524194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.524795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.525155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.559582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] MFA Rules not processed for user `a94970e1593640a2ad24f57b4b337b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:35.561724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.648698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1056/2103] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:35.660994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.662927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.732627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b929-8b77-46df-ab08-04778df86d77 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.737292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.738150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.738653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.739029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.748677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.750266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:35.761290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1048/2104] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:35.868446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:35.869943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:35.960885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527973a-848b-443a-97d9-08efb15fd197 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:35.967594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:35.968513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:35.968790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:35.969059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] PATH_INFO: `/v3/projects/bc60d687694c4e56812e020e6d382253` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:35.970325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc60d687694c4e56812e020e6d382253)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:35.972207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.020721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc60d687694c4e56812e020e6d382253', 'request_id': 'req-ab04ef4b-5c32-477e-9080-ff7151d7a950'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.027021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc60d687694c4e56812e020e6d382253', 'request_id': 'req-ab04ef4b-5c32-477e-9080-ff7151d7a950'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.035619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc60d687694c4e56812e020e6d382253', 'request_id': 'req-ab04ef4b-5c32-477e-9080-ff7151d7a950'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.060802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] The token cache is being invalidate because project bc60d687694c4e56812e020e6d382253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:36.061295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.062753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.065084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1057/2105] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:35 2022] DELETE /identity/v3/projects/bc60d687694c4e56812e020e6d382253 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:36.068695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:36.080524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a20bb5-a437-4056-9e62-90fa05f4fb03 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:36.151072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:36.151961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.152306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.152694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] PATH_INFO: `/v3/users/57a90fa1c5fa4c83a5a99203b8fc1257` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.153969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a90fa1c5fa4c83a5a99203b8fc1257)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:36.157199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.204556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a90fa1c5fa4c83a5a99203b8fc1257'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.205213 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a90fa1c5fa4c83a5a99203b8fc1257'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.205860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a90fa1c5fa4c83a5a99203b8fc1257'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.218463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a90fa1c5fa4c83a5a99203b8fc1257'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.227798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a90fa1c5fa4c83a5a99203b8fc1257'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.242553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1049/2106] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:36 2022] DELETE /identity/v3/users/57a90fa1c5fa4c83a5a99203b8fc1257 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:36.363449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:36.364989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:36.380618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04ef4b-5c32-477e-9080-ff7151d7a950 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:36.463035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:36.477070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.477370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.477637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] PATH_INFO: `/v3/users/14571f29e43e477799f5d23741307671` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.482479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14571f29e43e477799f5d23741307671)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:36.485087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.540749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14571f29e43e477799f5d23741307671'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.541832 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14571f29e43e477799f5d23741307671'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.542442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14571f29e43e477799f5d23741307671'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.557002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14571f29e43e477799f5d23741307671'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.558025 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:36.559894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:36.568364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14571f29e43e477799f5d23741307671'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.576646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4603-4726-48e3-ad5c-ba241fc4f2d4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:36.581771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:36.581946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1058/2107] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:36 2022] DELETE /identity/v3/users/14571f29e43e477799f5d23741307671 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:36.582688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.582958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.583219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] PATH_INFO: `/v3/projects/0e272556c5a7402190265b17fb9b6719` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.584395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e272556c5a7402190265b17fb9b6719)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:36.586549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.635096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e272556c5a7402190265b17fb9b6719', 'request_id': 'req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.641222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e272556c5a7402190265b17fb9b6719', 'request_id': 'req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.647848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e272556c5a7402190265b17fb9b6719', 'request_id': 'req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.660443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] The token cache is being invalidate because project 0e272556c5a7402190265b17fb9b6719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:36.660659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.661283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.662940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1050/2108] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:36 2022] DELETE /identity/v3/projects/0e272556c5a7402190265b17fb9b6719 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:36.667398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:36.668955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:36.733122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797526-d607-4506-aedc-c7beb716b053 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:36.763500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:36.765266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:36.791506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:36.792388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.792665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.793224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] PATH_INFO: `/v3/users/5ebe56b2424441e1a65d3028ef66ff85` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.794402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebe56b2424441e1a65d3028ef66ff85)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:36.797018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.833115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aeabf-f905-4c68-9762-7db2b00b1ff8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:36.838763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:36.840444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.840444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.840444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] PATH_INFO: `/v3/projects/9581428b0f134e63a2b7971b8ce04ba8` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.841676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9581428b0f134e63a2b7971b8ce04ba8)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:36.844451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:36.848458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebe56b2424441e1a65d3028ef66ff85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.848458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebe56b2424441e1a65d3028ef66ff85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.848895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebe56b2424441e1a65d3028ef66ff85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.861370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebe56b2424441e1a65d3028ef66ff85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.871703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c4ac5149-6cfe-43bd-9ced-96b6e37c5df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebe56b2424441e1a65d3028ef66ff85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.887509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1059/2109] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:36 2022] DELETE /identity/v3/users/5ebe56b2424441e1a65d3028ef66ff85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:36.894334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9581428b0f134e63a2b7971b8ce04ba8', 'request_id': 'req-80a208d3-5960-4d6f-bd73-7f6f51217c5f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.899516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9581428b0f134e63a2b7971b8ce04ba8', 'request_id': 'req-80a208d3-5960-4d6f-bd73-7f6f51217c5f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.905862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9581428b0f134e63a2b7971b8ce04ba8', 'request_id': 'req-80a208d3-5960-4d6f-bd73-7f6f51217c5f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.920134 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] The token cache is being invalidate because project 9581428b0f134e63a2b7971b8ce04ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:36.920453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.921114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-80a208d3-5960-4d6f-bd73-7f6f51217c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:36.926003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1051/2110] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:36 2022] DELETE /identity/v3/projects/9581428b0f134e63a2b7971b8ce04ba8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:36.928340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:36.929109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:36.929422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:36.949933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:36.951173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.016562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1060/2111] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:37.024267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.024558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.024839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.044406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:37.046293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.056161 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1052/2112] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:37.060339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.070310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3046-0ef5-40e1-905f-b74426fed234 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.075169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.075813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.076087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.076385 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.077426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:37.077763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.079363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.090640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1061/2113] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:37.095427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.104261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4e2a1-096f-49f5-8f6b-56bff1499492 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.110020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.110659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.110936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.112512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.112512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.113903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.145853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1053/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:37.148145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.159297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e1d0-e913-4045-a5ca-4cda316aed95 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.181351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.184950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.223558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.224263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.224473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.224752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.225418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.227408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.251988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1062/2115] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:37.253029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.263242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997d4c3-a0cf-4872-a0d7-53295c97ae62 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.268659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.269430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.269776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.270146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.270926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.271597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5f73-1212-4fba-9272-db08ead54a36 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.272703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.276964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.277841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.278121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.278393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] PATH_INFO: `/v3/projects/dbd55c9a7f0d4116bd24d336776900c8` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.279715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd55c9a7f0d4116bd24d336776900c8)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.281947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.283792 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1063/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:37.287493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.298058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab1a2-79ae-42b8-be16-f2e90d47d41d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.303068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.303726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.304020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.304284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.304993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.306609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.321087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1064/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:37.322931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.333911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62308-2b9a-4b50-9efa-9e3e0c8ef7ac admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.341366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd55c9a7f0d4116bd24d336776900c8', 'request_id': 'req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:37.347626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd55c9a7f0d4116bd24d336776900c8', 'request_id': 'req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:37.355396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd55c9a7f0d4116bd24d336776900c8', 'request_id': 'req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:37.371095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] The token cache is being invalidate because project dbd55c9a7f0d4116bd24d336776900c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:37.371341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:37.372010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2ef5e976-36c7-46b0-a6f3-157dddde4fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:37.374271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1054/2118] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:37 2022] DELETE /identity/v3/projects/dbd55c9a7f0d4116bd24d336776900c8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:37.379018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8935a8-a206-4a0f-acb9-216062e8fd1a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.379406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8935a8-a206-4a0f-acb9-216062e8fd1a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.379761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8935a8-a206-4a0f-acb9-216062e8fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.399866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ab8935a8-a206-4a0f-acb9-216062e8fd1a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:37.401073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ab8935a8-a206-4a0f-acb9-216062e8fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.401478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.402625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.402990 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.403314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] PATH_INFO: `/v3/projects/2a58ec5ecdf84164a57e7d78d5dcecd1/users/6239d81f06714c63ae74423b432ea583/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.411110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1055/2119] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:37.418818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.419227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.419610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.419860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ec5ecdf84164a57e7d78d5dcecd1, user_id=6239d81f06714c63ae74423b432ea583, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.423168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b5836-afbf-4374-b677-dd6ecf098277 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.438502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1065/2120] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:37 2022] PUT /identity/v3/projects/2a58ec5ecdf84164a57e7d78d5dcecd1/users/6239d81f06714c63ae74423b432ea583/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:37.443837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.444128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.444410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.445485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:37.446864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.467439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:37.473125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.525075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1056/2121] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:37.529250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.542196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df84a6-782c-4e88-b4d3-3b3bcb77fd1b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.550723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1066/2122] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:57:37.557678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.557678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.557678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.557678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.558348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:37.558761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.560743 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.562547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.564406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.574440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1057/2123] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:57:37.578965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.590362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd855b-1da5-4cfc-abac-2873f2368c89 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.596602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.597444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.597798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.598162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.598938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.601893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.625910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817fb9e-5b97-42a4-9bf8-78514c11fefd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.629694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.630331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.630716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.630879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.632567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1058/2124] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:37.636637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.641311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.642791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.652756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1067/2125] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:37.707390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f7de-3ebe-4975-8b3b-1a79051159be admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.713021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.713715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.713997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.714514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.714953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.717432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.744431 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1059/2126] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:37.748881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.759544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd65bb-1f0d-44a6-8020-350472293e5c service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.765442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.766018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.766399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.766561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.767471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.769040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.780524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1068/2127] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:37.784760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.797201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf983-3170-45ea-9f9f-e5b43ad9b574 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.806565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.806984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.807593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.807963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.808977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.810375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47018c74-5dde-4245-8330-9dcb23e92b40 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.823640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1060/2128] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:57:37.829083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.843196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6cee-646a-48ea-af7c-d2124460fde1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:37.849423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:37.850384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.850662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.850942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] PATH_INFO: `/v3/projects/3e8200fa89aa45999bcff01e12d7dc3c/users/654e423a6fa443c89ecd78c961bb1454/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.867193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8200fa89aa45999bcff01e12d7dc3c, user_id=654e423a6fa443c89ecd78c961bb1454, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:37.869903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:37.885861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1069/2129] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:37 2022] PUT /identity/v3/projects/3e8200fa89aa45999bcff01e12d7dc3c/users/654e423a6fa443c89ecd78c961bb1454/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:57:37.892005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c10d-9b53-42f8-81a0-cc2cac5cc807 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:37.892292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c10d-9b53-42f8-81a0-cc2cac5cc807 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:37.892592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c10d-9b53-42f8-81a0-cc2cac5cc807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:37.914913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b4a9c10d-9b53-42f8-81a0-cc2cac5cc807 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:37.916727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b4a9c10d-9b53-42f8-81a0-cc2cac5cc807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:37.983103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1061/2130] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:37.993933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:37.996197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:38.077141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e79ed-e26d-4f6b-880f-5c8f2c7f97f0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:38.081225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:38.081930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:38.082207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:38.082477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:38.096553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:38.098229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:38.109263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1070/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:57:39.081209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282c19-4235-4160-96e1-fec8eb9c1101 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:39.081745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282c19-4235-4160-96e1-fec8eb9c1101 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:39.081874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27282c19-4235-4160-96e1-fec8eb9c1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:39.112218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-27282c19-4235-4160-96e1-fec8eb9c1101 None None] MFA Rules not processed for user `654e423a6fa443c89ecd78c961bb1454`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:39.113568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-27282c19-4235-4160-96e1-fec8eb9c1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:39.205554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1062/2132] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:39.216484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:39.219216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:39.293258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32378-1a84-4b13-b3c3-278f0e09181f service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:39.298976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:39.299957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:39.300265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:39.300577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:39.309638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:39.312606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:39.324383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1071/2133] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:40.818304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7dc-e3e6-4b67-84df-5454f177378c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:40.818783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7dc-e3e6-4b67-84df-5454f177378c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:40.818876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7dc-e3e6-4b67-84df-5454f177378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:40.838835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-74f5a7dc-e3e6-4b67-84df-5454f177378c None None] MFA Rules not processed for user `654e423a6fa443c89ecd78c961bb1454`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:40.840844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-74f5a7dc-e3e6-4b67-84df-5454f177378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:40.850074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1063/2134] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:41.034697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:41.036819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:41.051509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e872a-3889-4b50-8cb0-52e51180668a service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:41.061973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:41.063021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:41.063389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:41.063904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] PATH_INFO: `/v3/users/a94970e1593640a2ad24f57b4b337b1a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:41.065706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94970e1593640a2ad24f57b4b337b1a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:41.068158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:41.132606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94970e1593640a2ad24f57b4b337b1a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:41.133381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94970e1593640a2ad24f57b4b337b1a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:41.134091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94970e1593640a2ad24f57b4b337b1a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:41.147519 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94970e1593640a2ad24f57b4b337b1a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:41.157192 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94970e1593640a2ad24f57b4b337b1a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:41.174344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1072/2135] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:57:41 2022] DELETE /identity/v3/users/a94970e1593640a2ad24f57b4b337b1a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:41.178941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:41.179230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:41.179588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:41.203596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:41.204795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:41.282557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1064/2136] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:41.294435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:41.297005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:41.364535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3e29-b3a3-4d94-95e6-0356e80a7165 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:41.371123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:41.372525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:41.373826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:41.374569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:41.389888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:41.391563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d928-380e-4576-8e3a-668a997db954 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:41.403708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1073/2137] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:41.943746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:41.945960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:41.979103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4386063-12f3-4cae-a3c4-df01bc1f192e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:41.985082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:41.985825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:41.986175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:41.986653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] PATH_INFO: `/v3/projects/ca751f0c36b2497d9b5a782a6082505b` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:41.988722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca751f0c36b2497d9b5a782a6082505b)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:41.991714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.079952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca751f0c36b2497d9b5a782a6082505b', 'request_id': 'req-ef4707f5-d78b-4729-afe4-1fdb1ab65379'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:42.087254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca751f0c36b2497d9b5a782a6082505b', 'request_id': 'req-ef4707f5-d78b-4729-afe4-1fdb1ab65379'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:42.095451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca751f0c36b2497d9b5a782a6082505b', 'request_id': 'req-ef4707f5-d78b-4729-afe4-1fdb1ab65379'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:42.114803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] The token cache is being invalidate because project ca751f0c36b2497d9b5a782a6082505b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:57:42.115297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:42.117297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ef4707f5-d78b-4729-afe4-1fdb1ab65379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:57:42.119119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1065/2138] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:57:41 2022] DELETE /identity/v3/projects/ca751f0c36b2497d9b5a782a6082505b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:42.125597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.126123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.127675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.167393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:42.168645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:42.279086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1074/2139] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:42.287117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.287409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.287690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.320941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:42.322485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:42.340493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1066/2140] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:42.341740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.365714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8505b-3afb-4358-9add-b5e794297963 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.373712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.376087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.376558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.376976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.380744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:57:42.381157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.382733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.405598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1075/2141] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:57:42.406861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.428914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d40c26-8d6a-486d-9f17-ebf25d3b1431 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.443116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.443943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.444439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.444929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.446065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.449007 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.520732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1067/2142] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:57:42 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:42.522572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.558066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a49c-a09d-4b6a-bcc3-b2f2b87be7e4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.669290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.671506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.671950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.673203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.674740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.680471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.710743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1076/2143] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:57:42 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:57:42.711176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.728089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf5c7-fbc0-41a0-a8d6-a04ec7d03c0b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.735486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.736775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.736775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.736775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.737440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.740159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.752785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1068/2144] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:42.756687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.767142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a777b-3974-41ee-82e6-d91694477e20 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.771904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.772626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.773055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.773344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.774128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.775740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997c639-d966-4ff5-85cc-4c20466f31dd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.788036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1077/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:57:42.792444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:42.805560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd042f-0298-4530-9815-3dc87d25c790 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:42.811924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:42.812900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.813274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.813779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] PATH_INFO: `/v3/projects/168ec2c04f5c44a18209ffccf46619bb/users/8c04503eed224ec7ab682fed072f58be/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.837469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168ec2c04f5c44a18209ffccf46619bb, user_id=8c04503eed224ec7ab682fed072f58be, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:42.840769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:42.856693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1069/2146] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:57:42 2022] PUT /identity/v3/projects/168ec2c04f5c44a18209ffccf46619bb/users/8c04503eed224ec7ab682fed072f58be/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:57:42.868828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a76043-3fbf-4ef0-b00e-75d61f3119fd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:42.869128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a76043-3fbf-4ef0-b00e-75d61f3119fd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:42.869405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a76043-3fbf-4ef0-b00e-75d61f3119fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:42.903948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-24a76043-3fbf-4ef0-b00e-75d61f3119fd None None] MFA Rules not processed for user `8c04503eed224ec7ab682fed072f58be`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:42.905903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-24a76043-3fbf-4ef0-b00e-75d61f3119fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:42.991736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1078/2147] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:43.005987 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:43.008141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:43.088502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48957b-ea55-4e09-aa81-e339990c4912 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:43.095335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:43.096389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:43.096859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:43.097226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:43.110758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:43.112872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:43.140267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1070/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:43.558885 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162606d-1ed9-4ed9-b4ea-e5997803c6e7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:43.559375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162606d-1ed9-4ed9-b4ea-e5997803c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:43.559468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162606d-1ed9-4ed9-b4ea-e5997803c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:43.586903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1162606d-1ed9-4ed9-b4ea-e5997803c6e7 None None] MFA Rules not processed for user `6239d81f06714c63ae74423b432ea583`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:43.588193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1162606d-1ed9-4ed9-b4ea-e5997803c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:43.651485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1079/2149] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:57:43.663411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:57:43.664834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:43.739387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914e06-7035-4a01-8c95-7e3d12735810 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:57:43.745120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:57:43.745811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:43.746094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:43.746366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:43.754649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:57:43.756218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:57:43.764873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1071/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:57:45.698355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084044-85e2-44ea-86d3-777c1be4cba6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:57:45.698860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084044-85e2-44ea-86d3-777c1be4cba6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:57:45.698950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084044-85e2-44ea-86d3-777c1be4cba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:57:45.717962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-df084044-85e2-44ea-86d3-777c1be4cba6 None None] MFA Rules not processed for user `6239d81f06714c63ae74423b432ea583`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:57:45.719149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-df084044-85e2-44ea-86d3-777c1be4cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:57:45.726149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1080/2151] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:03.236127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:03.237628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:03.303356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd05ed6-bfd1-49e0-b8e4-8a3e18dbc079 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:03.307815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:03.308673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:03.309011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:03.309217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] PATH_INFO: `/v3/users/5e4b7ca3d4f04848ba50347f57ab3684` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:03.311233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4b7ca3d4f04848ba50347f57ab3684)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:03.313082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:03.360659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4b7ca3d4f04848ba50347f57ab3684'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.361095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4b7ca3d4f04848ba50347f57ab3684'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.361726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4b7ca3d4f04848ba50347f57ab3684'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.373958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4b7ca3d4f04848ba50347f57ab3684'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.381356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4b7ca3d4f04848ba50347f57ab3684'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.394821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1072/2152] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:58:03 2022] DELETE /identity/v3/users/5e4b7ca3d4f04848ba50347f57ab3684 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:03.399180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:03.399656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:03.399784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:03.416377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:03.417548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:03.476595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1081/2153] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:03.487336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:03.488748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:03.546470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590fca-7504-4730-b78f-07e57f01b100 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:03.550351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:03.551024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:03.551307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:03.551660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:03.562058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:03.563737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daf9ea-ad77-41c9-aeb5-d5a9e325e22d service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:03.574387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1073/2154] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:58:03.839578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:03.841868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:03.858445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d3ea-16c2-4dcd-b9f0-df403249d0e1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:03.865891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:03.866758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:03.867105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:03.867368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] PATH_INFO: `/v3/projects/4bd45432c89947d68353fb8c010551f6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:03.868536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd45432c89947d68353fb8c010551f6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:03.870443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:03.917575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd45432c89947d68353fb8c010551f6', 'request_id': 'req-6c962f83-a599-47ee-9779-5926b96c5116'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.923361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd45432c89947d68353fb8c010551f6', 'request_id': 'req-6c962f83-a599-47ee-9779-5926b96c5116'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.929330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd45432c89947d68353fb8c010551f6', 'request_id': 'req-6c962f83-a599-47ee-9779-5926b96c5116'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.942996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] The token cache is being invalidate because project 4bd45432c89947d68353fb8c010551f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:58:03.943282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.943904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c962f83-a599-47ee-9779-5926b96c5116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:03.945434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1082/2155] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:58:03 2022] DELETE /identity/v3/projects/4bd45432c89947d68353fb8c010551f6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:03.950678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:03.951220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:03.951564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:03.970145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:03.971341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.029038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1074/2156] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:04.037223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.037510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.037842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.056183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:04.057365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.065889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1083/2157] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:04.070247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.080397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7035b-54b0-480a-9226-8b16002fc43b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.084997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.085578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.085884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.086155 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.086866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:58:04.087166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.088728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.100629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1075/2158] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:58:04.104911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.115097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2aaaa0-1a74-4824-80bf-0ee3211b9e4a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.119755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.120408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.120687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.120958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.121682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.123791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.152746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1084/2159] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:58:04.157329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.167378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca51d5-ab98-4a0e-bc76-7be3a5f2727d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.236657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.237337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.237622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.237939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.238636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.240551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.265212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1076/2160] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:58:04.269344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.285423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29d3f-35d4-47ed-bcb8-bd74adbf0a53 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.291424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.292389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.292820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.293222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.294627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.296689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.309849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1085/2161] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:58:04.314191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.326942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532dfb-cf21-4e01-99f7-40bd0926c346 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.332914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.333666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.334047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.334395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.335247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.336966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cffebf-6ed9-4729-9467-6e79c5e55468 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.348480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1077/2162] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:58:04.354617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.367450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b26a-2951-4779-bac8-c565f637ce06 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.373091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.375351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.376076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.376490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] PATH_INFO: `/v3/projects/a2abb7d7a43b41d3b77673ee427e726c/users/b5e58d5ff2cc4248a6b5b22778258445/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.400396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2abb7d7a43b41d3b77673ee427e726c, user_id=b5e58d5ff2cc4248a6b5b22778258445, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.403053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.416983 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1086/2163] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:58:04 2022] PUT /identity/v3/projects/a2abb7d7a43b41d3b77673ee427e726c/users/b5e58d5ff2cc4248a6b5b22778258445/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:04.427719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.428001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.428272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.458787 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] MFA Rules not processed for user `b5e58d5ff2cc4248a6b5b22778258445`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:04.460469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.541170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1078/2164] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:04.554410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.556070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.613584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a8488-7746-4c3c-b07a-b81395f9816d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.617734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.618378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.618657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.619081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.628315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.630942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.640514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1087/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:58:04.658590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.665141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.665976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.732964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950271be-6ff4-4fb6-94a0-b0db388365e7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.740181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.741409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.742826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.743105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] PATH_INFO: `/v3/users/8c04503eed224ec7ab682fed072f58be` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.744467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c04503eed224ec7ab682fed072f58be)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.746475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.749851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3435a-9ead-43a7-91cc-db926adff998 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:04.755012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:04.755811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.756187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.756670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] PATH_INFO: `/v3/users/b5e58d5ff2cc4248a6b5b22778258445` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.763841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e58d5ff2cc4248a6b5b22778258445)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:04.766014 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:04.830523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e58d5ff2cc4248a6b5b22778258445'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.831514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e58d5ff2cc4248a6b5b22778258445'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.832398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e58d5ff2cc4248a6b5b22778258445'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.836002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c04503eed224ec7ab682fed072f58be'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.836666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c04503eed224ec7ab682fed072f58be'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.838480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c04503eed224ec7ab682fed072f58be'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.845744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e58d5ff2cc4248a6b5b22778258445'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.857040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d21f5f90-69bb-42f8-8704-5b83559a64ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e58d5ff2cc4248a6b5b22778258445'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.859648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c04503eed224ec7ab682fed072f58be'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.869190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9f86c16a-815e-4091-8cb1-1b57baffc5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c04503eed224ec7ab682fed072f58be'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:04.875356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1088/2166] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:58:04 2022] DELETE /identity/v3/users/b5e58d5ff2cc4248a6b5b22778258445 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:58:04.880586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.881174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.881870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.891754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1079/2167] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:58:04 2022] DELETE /identity/v3/users/8c04503eed224ec7ab682fed072f58be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:04.896824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:04.897118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:04.897396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:04.912539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:04.914187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.917187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:04.918165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.983476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1080/2168] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:04.992917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1089/2169] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:04.993852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:04.995318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:04.998931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.001031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.057672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76bcee-7cda-4d1e-ba62-747348091be0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.062820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.063674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.064064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.064432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.070457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1926368-ca5e-4369-a7c9-89795a822a37 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.074844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.076375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.076499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.076969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.077390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.078182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.087737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.089414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1081/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:58:05.089741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.101522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1090/2171] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:58:05.459690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.461128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.467456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.469225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.480777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6fcd-4168-44f5-98dd-50251eea493b service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.494228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d329-bb61-4c29-88f3-7eb2e5e487fb service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.495511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.497721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.498980 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.499788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] PATH_INFO: `/v3/projects/168ec2c04f5c44a18209ffccf46619bb` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.501414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168ec2c04f5c44a18209ffccf46619bb)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.503720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.509448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.510477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.510768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.511041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] PATH_INFO: `/v3/projects/a2abb7d7a43b41d3b77673ee427e726c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.513757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2abb7d7a43b41d3b77673ee427e726c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.516246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.564070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168ec2c04f5c44a18209ffccf46619bb', 'request_id': 'req-401ebc73-0d58-4885-a980-6ebb14c8fad6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.569792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168ec2c04f5c44a18209ffccf46619bb', 'request_id': 'req-401ebc73-0d58-4885-a980-6ebb14c8fad6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.570250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2abb7d7a43b41d3b77673ee427e726c', 'request_id': 'req-58196fba-4672-49fc-b8a2-a36cdad9b142'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.576453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168ec2c04f5c44a18209ffccf46619bb', 'request_id': 'req-401ebc73-0d58-4885-a980-6ebb14c8fad6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.577403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2abb7d7a43b41d3b77673ee427e726c', 'request_id': 'req-58196fba-4672-49fc-b8a2-a36cdad9b142'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.584277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2abb7d7a43b41d3b77673ee427e726c', 'request_id': 'req-58196fba-4672-49fc-b8a2-a36cdad9b142'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.592821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] The token cache is being invalidate because project 168ec2c04f5c44a18209ffccf46619bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:58:05.593233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.594038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-401ebc73-0d58-4885-a980-6ebb14c8fad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.597732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1082/2172] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:58:05 2022] DELETE /identity/v3/projects/168ec2c04f5c44a18209ffccf46619bb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:05.600481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] The token cache is being invalidate because project a2abb7d7a43b41d3b77673ee427e726c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:58:05.600843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.600946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4ae8-2187-4813-9aff-43e6a89d96a0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.601389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4ae8-2187-4813-9aff-43e6a89d96a0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.601708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-58196fba-4672-49fc-b8a2-a36cdad9b142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:05.601823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b4ae8-2187-4813-9aff-43e6a89d96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.603527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1091/2173] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:58:05 2022] DELETE /identity/v3/projects/a2abb7d7a43b41d3b77673ee427e726c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:05.608715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b149e4-dcf1-4c44-a140-100086e2aaee None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.608941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b149e4-dcf1-4c44-a140-100086e2aaee None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.609490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b149e4-dcf1-4c44-a140-100086e2aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.624286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6d2b4ae8-2187-4813-9aff-43e6a89d96a0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:05.625489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6d2b4ae8-2187-4813-9aff-43e6a89d96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.629776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f1b149e4-dcf1-4c44-a140-100086e2aaee None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:05.630963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f1b149e4-dcf1-4c44-a140-100086e2aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.691529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1083/2174] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:05.698972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.699365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.699509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1092/2175] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:05.701459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.707824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.708221 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.708594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.720178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:05.721369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.728970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:05.729532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1084/2176] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:05.730307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:05.733551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.740062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1093/2177] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:05.743693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.745116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d2d49-3cfc-4d61-b473-24066659940c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.751248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.751909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.752189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.752464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.753193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:58:05.753502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.753814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd1af-b595-4b6e-b8be-86824ee356b1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.755192 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.758640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.759307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.759561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.759978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.760698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:58:05.761035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.763142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.770172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1085/2178] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:58:05.774467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.778916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1094/2179] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:58:05.779866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.789449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb356-0a6c-4a4d-a765-43e3506c0153 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.789691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef4686-524c-45dd-a289-0a4da26c2d00 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.794493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.795143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.795310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.795460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.795682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.796529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.796648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.796737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.796821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.797573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.798272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.799730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.830123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1095/2180] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:58:05.831413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.837126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1086/2181] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:58:05.838146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.897353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d3da-fbe1-44e3-976e-4a8adea3e5cd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.902152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.902821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.903102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.903959 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.904647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.905674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227179-ec69-4f9d-aa11-19886e5c908c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.906584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.910347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.911003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.911284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.911555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.912230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.914152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.926022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1096/2182] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:58:05.929991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.933739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1087/2183] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:58:05 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:58:05.938475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.943556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1a79-4cb1-43f8-a839-ee5a8a232353 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.948328 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.948524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ebc3-3d96-42e0-9f32-7bfcb28a6c98 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.948964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.949251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.949527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.950825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.952439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.953783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.954427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.954709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.954984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.955699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.957293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.962591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1097/2184] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:58:05.967048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.967803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1088/2185] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:58:05.971395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:05.976807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b16a-07e3-4469-8d21-9f8a6cc0a7f4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.980809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e41e-4f1b-4e44-a201-9aab2d330221 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:05.981720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.982352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.982634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.982908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.983649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.985257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.986206 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:05.986920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:05.987372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:05.987821 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:05.988545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:05.990225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:05.995623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1098/2186] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:58:06.000187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:06.002951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1089/2187] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:58:06.006781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:06.009615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70acb1f-451d-4f9b-afc7-6d2bffd727af admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:06.015164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:06.016025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.016300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.016394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89bd1-a433-41b8-9f18-00e97cd16ae6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:06.016583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] PATH_INFO: `/v3/projects/0c36a414484441deb0f56ba69fdc3339/users/784d4b45d3af4dc9b5532b12bb8a30aa/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.021003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:06.021899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.022182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.022458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] PATH_INFO: `/v3/projects/8343e2c553774ea5be8435da58ae8ac9/users/7dcc0457177546bdb1e7f6f9d4548a07/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.031674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c36a414484441deb0f56ba69fdc3339, user_id=784d4b45d3af4dc9b5532b12bb8a30aa, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:06.034478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798b42d-7db0-4fb5-8b29-543d4283dfec admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:06.037028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8343e2c553774ea5be8435da58ae8ac9, user_id=7dcc0457177546bdb1e7f6f9d4548a07, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:06.039682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396915-d490-42a1-810d-18916cb18db3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:06.047573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1099/2188] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:58:05 2022] PUT /identity/v3/projects/0c36a414484441deb0f56ba69fdc3339/users/784d4b45d3af4dc9b5532b12bb8a30aa/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:58:06.052951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1090/2189] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:58:06 2022] PUT /identity/v3/projects/8343e2c553774ea5be8435da58ae8ac9/users/7dcc0457177546bdb1e7f6f9d4548a07/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:58:06.058386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.058676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.058955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.064655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.065351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.065626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.092483 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] MFA Rules not processed for user `784d4b45d3af4dc9b5532b12bb8a30aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:06.093846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:06.098853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] MFA Rules not processed for user `7dcc0457177546bdb1e7f6f9d4548a07`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:06.100092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:06.183700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1100/2190] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:06.190955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1091/2191] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:06.196787 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:06.198923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:06.201243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:06.202749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:06.274612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b0bb-992e-496b-8502-fee08326ad3e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:06.279387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ce62-41b0-4d9a-9cae-9b9de6ef6c2e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:06.280121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:06.280958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.281384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.281833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.284343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:06.285233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:06.286029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:06.286406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:06.299999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:06.301728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b21b-35b3-46b6-8cff-8771868f22fe service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:06.302374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:06.304036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:06.312165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1092/2192] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:58:06.319336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1101/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:58:07.872253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcfbe7-03f5-4f11-b6f0-bf52a59e9ac7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:07.872768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcfbe7-03f5-4f11-b6f0-bf52a59e9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:07.872768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcfbe7-03f5-4f11-b6f0-bf52a59e9ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:07.890130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-29fcfbe7-03f5-4f11-b6f0-bf52a59e9ac7 None None] MFA Rules not processed for user `784d4b45d3af4dc9b5532b12bb8a30aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:07.891293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-29fcfbe7-03f5-4f11-b6f0-bf52a59e9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:07.898070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1093/2194] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:13.536569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:13.604896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be643b1-9f94-4a5e-bcf2-972a34d633cd service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:13.609877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:13.610745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:13.611023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:13.611457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] PATH_INFO: `/v3/users/7dcc0457177546bdb1e7f6f9d4548a07` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:13.612652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcc0457177546bdb1e7f6f9d4548a07)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:13.614604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:13.659179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcc0457177546bdb1e7f6f9d4548a07'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:13.659744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcc0457177546bdb1e7f6f9d4548a07'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:13.660332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcc0457177546bdb1e7f6f9d4548a07'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:13.671312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcc0457177546bdb1e7f6f9d4548a07'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:13.677976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcc0457177546bdb1e7f6f9d4548a07'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:13.690849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1102/2195] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:58:13 2022] DELETE /identity/v3/users/7dcc0457177546bdb1e7f6f9d4548a07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:13.695479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:13.695962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:13.696052 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:13.714321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:13.715551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:13.772721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1094/2196] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:13.782163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:13.783572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:13.838790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052086e-ba66-415d-8cca-6f67e3982008 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:13.842435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:13.843062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:13.843338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:13.843612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:13.852340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:13.853767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d9a2f-0dd3-4a2d-93ae-46d09650b059 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:13.863485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1103/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:58:14.134292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:14.135690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:14.150880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a6f3-2546-417e-96c3-d8556399d68a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:14.171391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:14.172267 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:14.172549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:14.172823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] PATH_INFO: `/v3/projects/8343e2c553774ea5be8435da58ae8ac9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:14.174068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8343e2c553774ea5be8435da58ae8ac9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:14.176087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:14.225921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8343e2c553774ea5be8435da58ae8ac9', 'request_id': 'req-831991e7-ae9c-4ef4-b742-6be44d2011bf'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:14.232487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8343e2c553774ea5be8435da58ae8ac9', 'request_id': 'req-831991e7-ae9c-4ef4-b742-6be44d2011bf'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:14.238780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8343e2c553774ea5be8435da58ae8ac9', 'request_id': 'req-831991e7-ae9c-4ef4-b742-6be44d2011bf'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:14.251389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] The token cache is being invalidate because project 8343e2c553774ea5be8435da58ae8ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:58:14.251669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:14.252298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-831991e7-ae9c-4ef4-b742-6be44d2011bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:14.253861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1095/2198] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:58:14 2022] DELETE /identity/v3/projects/8343e2c553774ea5be8435da58ae8ac9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:17.928495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab723-36da-4cfd-86aa-8ea11c2a79bc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:17.929129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab723-36da-4cfd-86aa-8ea11c2a79bc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:17.929129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab723-36da-4cfd-86aa-8ea11c2a79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:17.948935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1b2ab723-36da-4cfd-86aa-8ea11c2a79bc None None] MFA Rules not processed for user `654e423a6fa443c89ecd78c961bb1454`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:17.950275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1b2ab723-36da-4cfd-86aa-8ea11c2a79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:18.009689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1104/2199] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:32.629095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4c69c-a041-4b23-906d-2387926768f8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:32.629865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4c69c-a041-4b23-906d-2387926768f8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:32.630144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4c69c-a041-4b23-906d-2387926768f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:32.659664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6ac4c69c-a041-4b23-906d-2387926768f8 None None] MFA Rules not processed for user `d677d0933a2f4a05895b92165d857d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:32.660873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6ac4c69c-a041-4b23-906d-2387926768f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:32.735894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1096/2200] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:35.694612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:35.695128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:35.695225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:35.713392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] MFA Rules not processed for user `ed75e7f09b1d4b60b45f7b024de32683`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:35.715319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:35.770722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1105/2201] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:37.350994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad52-a671-4e79-a89f-7af19e9a8502 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:37.351450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad52-a671-4e79-a89f-7af19e9a8502 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:37.351540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad52-a671-4e79-a89f-7af19e9a8502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:37.378542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-60e7ad52-a671-4e79-a89f-7af19e9a8502 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:37.379700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-60e7ad52-a671-4e79-a89f-7af19e9a8502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:37.450920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1097/2202] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:37.491205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:37.492585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:37.567642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efbf7e-e031-4915-9379-4667b5bdfbc7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:37.572584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:37.573233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:37.573514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:37.574809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:37.588653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:37.590482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:37.599419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1106/2203] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:58:38.181520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6144de-7d42-4f64-bcd6-5042fd2a265d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:38.181851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6144de-7d42-4f64-bcd6-5042fd2a265d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:38.182129 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6144de-7d42-4f64-bcd6-5042fd2a265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:38.200248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1b6144de-7d42-4f64-bcd6-5042fd2a265d None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:38.201418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1b6144de-7d42-4f64-bcd6-5042fd2a265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:38.208436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1098/2204] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:38.221595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:38.232447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec677-242f-46a3-afa1-0a68cf184b21 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:38.237438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:38.238104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:38.238386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:38.238657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:38.246535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:38.248043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:38.255987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1107/2205] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:58:38.465736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64e6-9162-4cfd-827c-078ac4e39406 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:38.466224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64e6-9162-4cfd-827c-078ac4e39406 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:38.466315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64e6-9162-4cfd-827c-078ac4e39406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:38.483781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-79db64e6-9162-4cfd-827c-078ac4e39406 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:38.484974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-79db64e6-9162-4cfd-827c-078ac4e39406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:38.492051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1099/2206] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:38.505228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:38.516481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216f7c-c638-4e99-87eb-6ab12c0a8e63 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:38.521451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:38.522118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:38.522400 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:38.523359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:38.531797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:38.533363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:38.542260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1108/2207] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 14:58:38.945832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:38.946127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:38.946411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:38.964116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:38.966003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:38.973102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1100/2208] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:38.986869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:38.997183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57bfb7-d655-448d-bdcc-53cc0e2b7f12 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:39.002173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:39.002740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:39.003019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:39.003287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:39.010955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:39.012772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9b29-8e01-4e81-a9c9-87497737cd2a service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:39.020475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1109/2209] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:58:41.129211 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:41.130697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:41.250068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3b256-4c91-49bf-95a4-b61d47024b8e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:41.256849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:41.257751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:41.258208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:41.258485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] PATH_INFO: `/v3/users/784d4b45d3af4dc9b5532b12bb8a30aa` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:41.260060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784d4b45d3af4dc9b5532b12bb8a30aa)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:41.262864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:41.330456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784d4b45d3af4dc9b5532b12bb8a30aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:41.331361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784d4b45d3af4dc9b5532b12bb8a30aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:41.332188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784d4b45d3af4dc9b5532b12bb8a30aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:41.345533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784d4b45d3af4dc9b5532b12bb8a30aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:41.353911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784d4b45d3af4dc9b5532b12bb8a30aa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:41.366984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1101/2210] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:58:41 2022] DELETE /identity/v3/users/784d4b45d3af4dc9b5532b12bb8a30aa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:41.372469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:41.373512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:41.374212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:41.409336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:41.410444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:41.496466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1110/2211] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:58:41.516668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:41.519631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:41.699172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3753f-3be5-4526-be89-1a76f3b7c2c0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:41.709048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:41.709919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:41.710299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:41.710607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:41.722958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:41.724670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f23581-7bfa-4728-a73b-94608958590d service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:41.749045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1102/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:58:42.188185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:42.190116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:42.207770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b322d1-82ff-4ec1-ad3b-0e52b4b4f822 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:42.219750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:42.220616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:42.221046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:42.221449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] PATH_INFO: `/v3/projects/0c36a414484441deb0f56ba69fdc3339` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:42.223215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c36a414484441deb0f56ba69fdc3339)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:42.225267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:42.321623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c36a414484441deb0f56ba69fdc3339', 'request_id': 'req-1551740c-1720-47c2-8afe-55af1175411d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:42.333395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c36a414484441deb0f56ba69fdc3339', 'request_id': 'req-1551740c-1720-47c2-8afe-55af1175411d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:42.344356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c36a414484441deb0f56ba69fdc3339', 'request_id': 'req-1551740c-1720-47c2-8afe-55af1175411d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:42.372806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] The token cache is being invalidate because project 0c36a414484441deb0f56ba69fdc3339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:58:42.373376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:42.377922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:58:42.386257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1111/2213] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:58:42 2022] DELETE /identity/v3/projects/0c36a414484441deb0f56ba69fdc3339 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:58:47.621999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd252-c352-4406-a2a6-53e95e21ce30 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:47.622418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd252-c352-4406-a2a6-53e95e21ce30 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:47.622567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd252-c352-4406-a2a6-53e95e21ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:47.640556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c02dd252-c352-4406-a2a6-53e95e21ce30 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:58:47.641783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c02dd252-c352-4406-a2a6-53e95e21ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:47.704437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1103/2214] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:58:47.716908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:58:47.718293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:58:47.787226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551740c-1720-47c2-8afe-55af1175411d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:58:47.793127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:58:47.794130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:58:47.794540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:58:47.794970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:58:47.803718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:58:47.805310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:58:47.814507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1112/2215] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:59:05.246573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:05.247099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:05.247202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:05.264947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:05.266157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:05.273123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1104/2216] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:05.285178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:05.295735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c63d-3ef9-42eb-b834-849922725a3c service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:05.300720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:05.301341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:05.301622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:05.301925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:05.310404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:05.311976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:05.319962 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1113/2217] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:59:07.182842 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.184338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:07.249515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df1f1-4e9b-4c18-b63c-ea0a158c6139 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.253908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.254771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.255053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.255327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] PATH_INFO: `/v3/users/654e423a6fa443c89ecd78c961bb1454` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.256517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654e423a6fa443c89ecd78c961bb1454)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.258452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:07.303263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654e423a6fa443c89ecd78c961bb1454'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.303901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654e423a6fa443c89ecd78c961bb1454'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.304493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654e423a6fa443c89ecd78c961bb1454'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.316067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654e423a6fa443c89ecd78c961bb1454'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.323843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-2a59a5d8-74c6-44e7-8b0b-1cf914c5ee57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654e423a6fa443c89ecd78c961bb1454'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.336790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1105/2218] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 14:59:07 2022] DELETE /identity/v3/users/654e423a6fa443c89ecd78c961bb1454 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:59:07.505313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.518449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c17e-56d4-47e0-820c-7413b1f30b0e service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.574864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.575715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.575992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.576265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] PATH_INFO: `/v3/projects/3e8200fa89aa45999bcff01e12d7dc3c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.577442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8200fa89aa45999bcff01e12d7dc3c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.579388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:07.623768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8200fa89aa45999bcff01e12d7dc3c', 'request_id': 'req-7a27e200-c7eb-4b60-a3b6-937665794ea7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.629159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8200fa89aa45999bcff01e12d7dc3c', 'request_id': 'req-7a27e200-c7eb-4b60-a3b6-937665794ea7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.635007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8200fa89aa45999bcff01e12d7dc3c', 'request_id': 'req-7a27e200-c7eb-4b60-a3b6-937665794ea7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.647491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] The token cache is being invalidate because project 3e8200fa89aa45999bcff01e12d7dc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:59:07.647773 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.648404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7a27e200-c7eb-4b60-a3b6-937665794ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:59:07.649956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1114/2219] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 14:59:07 2022] DELETE /identity/v3/projects/3e8200fa89aa45999bcff01e12d7dc3c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:59:07.654957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.655247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.655527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.702308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:07.703531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:07.759074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1106/2220] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:07.767347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.767639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.767920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.786703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:07.787899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:07.795777 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1115/2221] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:07.800056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.811021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12689d-22af-4703-9506-70e0851b4a8d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.815782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.816415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.816703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.816962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.817698 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:59:07.818006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.819579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:07.830809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1107/2222] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 14:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:59:07.834828 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.844330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e61d4-e8b5-4d8f-a106-af024727a8fa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.848940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.849573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.849882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.850156 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.850838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.852728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:07.877216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1116/2223] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:59:07.881274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.891939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480965a0-bd6a-4257-9f83-19eee7f2731b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.946817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.947481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.948296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.948560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.949245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.951188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:07.970336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1108/2224] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:59:07 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:59:07.974345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:07.984639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704f5f-3009-47a2-9f84-dfbd15b90e47 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:07.989217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:07.990067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:07.990345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:07.990615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:07.991326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:07.992889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:08.002827 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1117/2225] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:59:08.006877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:08.017408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd8e4-2d4e-44b6-bd82-ea17b1b0c730 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:08.022009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:08.022658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:08.022966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:08.023241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:08.023954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:08.025593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4891ee-5eb4-48c4-8b6d-31c0e26d87cc admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:08.036481 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1109/2226] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:59:08.040509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:08.050622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27803-1e54-47fb-846f-9af4e5b0297e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:08.055150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:08.056015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:08.056289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:08.056558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] PATH_INFO: `/v3/projects/00847662f3c54b2a81e47a0bcd5c3a08/users/396c93aa74a74f37b8a5377eeaca99e2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:08.071124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00847662f3c54b2a81e47a0bcd5c3a08, user_id=396c93aa74a74f37b8a5377eeaca99e2, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:08.074694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:08.086720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1118/2227] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:59:08 2022] PUT /identity/v3/projects/00847662f3c54b2a81e47a0bcd5c3a08/users/396c93aa74a74f37b8a5377eeaca99e2/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:59:08.092363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557576fa-d657-4950-9b10-8fdad0186698 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:08.092651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557576fa-d657-4950-9b10-8fdad0186698 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:08.092927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557576fa-d657-4950-9b10-8fdad0186698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:08.109952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-557576fa-d657-4950-9b10-8fdad0186698 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:08.111169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-557576fa-d657-4950-9b10-8fdad0186698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:08.169131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1110/2228] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:08.178526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:08.180675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:08.236232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c108596-aaa7-4d71-8647-c6009c48218c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:08.239825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:08.240518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:08.240793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:08.241058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:08.250474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:08.252212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:08.262596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1119/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:12.477484 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.478059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.478436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.514700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] MFA Rules not processed for user `396c93aa74a74f37b8a5377eeaca99e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:12.516085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:12.601115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1111/2230] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:12.606042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.616150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b53dc2-0526-4b31-a55b-aa94bb61331f service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:12.621742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:12.622453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.622733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.623005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.623726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:12.625588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:12.662513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1120/2231] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 14:59:12 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:59:12.666160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.678313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f2b4-6ea7-4376-912f-41d6be7b4bba None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:12.750487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:12.751156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.751438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.751718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.752419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:12.754372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:12.784396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1112/2232] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 14:59:12 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:59:12.785692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.796800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed01ba-9ee0-4bfb-b030-f7c677502016 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:12.801944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:12.802718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.803004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.803302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.804026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:12.805850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:12.817670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1121/2233] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:59:12.821877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.833572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7580a-7a58-4989-b64b-825156c7569e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:12.840266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:12.841687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.841973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.842245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] PATH_INFO: `/v3/projects/a35a525a5f3e4cd0a3d153391f764452/users/0e411eb7857b40f0877a154174810571/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.859654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35a525a5f3e4cd0a3d153391f764452, user_id=0e411eb7857b40f0877a154174810571, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:12.862490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:12.878580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1113/2234] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:59:12 2022] PUT /identity/v3/projects/a35a525a5f3e4cd0a3d153391f764452/users/0e411eb7857b40f0877a154174810571/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:59:12.883781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.897189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be193-f872-4da4-99da-f0aa33995976 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:12.967580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:12.968251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:12.968537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:12.968809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:12.969524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:12.971132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841b8a1-4020-43f6-ab59-64bbf298577e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:12.981123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1122/2235] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 14:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:59:12.985162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:12.995907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee606-029e-4e7b-8b48-d9571c97eb8e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:13.001300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:13.002275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:13.002571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:13.002841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] PATH_INFO: `/v3/projects/a35a525a5f3e4cd0a3d153391f764452/users/0e411eb7857b40f0877a154174810571/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:13.005062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35a525a5f3e4cd0a3d153391f764452, user_id=0e411eb7857b40f0877a154174810571, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:13.007936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:13.020067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1114/2236] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 14:59:12 2022] PUT /identity/v3/projects/a35a525a5f3e4cd0a3d153391f764452/users/0e411eb7857b40f0877a154174810571/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:59:17.837694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c66ad-f559-468e-a1fc-af565c77c7db None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:17.838599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c66ad-f559-468e-a1fc-af565c77c7db None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:17.839035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c66ad-f559-468e-a1fc-af565c77c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:17.870565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-217c66ad-f559-468e-a1fc-af565c77c7db None None] MFA Rules not processed for user `0e411eb7857b40f0877a154174810571`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:17.872201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-217c66ad-f559-468e-a1fc-af565c77c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:17.971354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1123/2237] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:17.983895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:17.986361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:18.096099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2ca9-af4d-43a7-97e6-8dfb08e6c55c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:18.101693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:18.102346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:18.102624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:18.102893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:18.161103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:18.162770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb178f2-b4d9-45ae-a92c-52c0ecf571a4 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:18.172838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1115/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:19.371280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:19.371809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:19.371905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:19.390621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] MFA Rules not processed for user `396c93aa74a74f37b8a5377eeaca99e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:19.391839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:19.401719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1124/2239] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:34.443387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:34.443884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:34.443992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:34.497586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:34.498868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:34.572901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1116/2240] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:34.584274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:34.585780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:34.671692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908be1e4-516d-4c9a-b1d9-b38b12bb5c94 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:34.676636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:34.677274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:34.677552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:34.677870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:34.686615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:34.688270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281082da-b122-4d2b-a21b-46a3fee1e33c service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:34.698235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1125/2241] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:59:38.126364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:38.127546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:38.246261 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f33e-7077-41cd-921b-5fe6254eea0b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:38.251426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:38.252070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:38.252351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:38.252626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:38.254447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:38.267048 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:38.268571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96bdca-25b8-4dcc-9db9-60575347edb3 service placement] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:38.279145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1117/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:51.170710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.171365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.171365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.172654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1126/2243] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:59:51.179618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074ff8-2b0c-4931-bc84-d2072e6ebf36 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.180173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074ff8-2b0c-4931-bc84-d2072e6ebf36 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.181188 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074ff8-2b0c-4931-bc84-d2072e6ebf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.224299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ed074ff8-2b0c-4931-bc84-d2072e6ebf36 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:51.225502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ed074ff8-2b0c-4931-bc84-d2072e6ebf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:51.236224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1118/2244] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:59:51.249886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:51.251923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:51.372750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f2579-6213-41cb-abff-9cfe0f20e67d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:51.376259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:51.376901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.377178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.377448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.387881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:51.389576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e458ba-f23d-4285-b9f9-4449fa8b1ff7 service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:51.406159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1127/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:51.480650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.480834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.481115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.482836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1119/2246] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:59:51.492447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b969d-4f4e-48c2-84bb-2cfe4a44a4d3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.492850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b969d-4f4e-48c2-84bb-2cfe4a44a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.493820 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b969d-4f4e-48c2-84bb-2cfe4a44a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.517037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-968b969d-4f4e-48c2-84bb-2cfe4a44a4d3 None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:51.518317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-968b969d-4f4e-48c2-84bb-2cfe4a44a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:51.596736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1128/2247] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:51.616921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:51.620056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:51.641180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe314-0af0-414f-ab38-77b0d0da3556 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:51.647661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:51.649095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.649543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.656936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.672098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:51.672098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97470a67-7f68-4965-bba2-e77096d5fe7f service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:51.687275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1120/2248] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:51.811922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e61d-ab79-44b4-a823-bf7fa644e9ba None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.812339 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e61d-ab79-44b4-a823-bf7fa644e9ba None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.812493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e61d-ab79-44b4-a823-bf7fa644e9ba None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.814396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1129/2249] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 14:59:51.820311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01c9a-d958-46e1-907f-4ba960c1d8f3 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.820783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01c9a-d958-46e1-907f-4ba960c1d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.821087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01c9a-d958-46e1-907f-4ba960c1d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.847303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-02b01c9a-d958-46e1-907f-4ba960c1d8f3 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:51.848509 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-02b01c9a-d958-46e1-907f-4ba960c1d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:51.860027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1121/2250] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:59:51.873560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e61d-ab79-44b4-a823-bf7fa644e9ba None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:51.888818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e61d-ab79-44b4-a823-bf7fa644e9ba None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:51.897344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:51.898057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:51.898397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:51.898734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:51.914154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:51.916830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:51.952438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1130/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:59:58.086578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:58.087068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:58.087264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:58.105243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:59:58.106449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:59:58.113343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1122/2252] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:59:58.125632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:58.136629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481ef03-663c-438e-898b-bdd7cdac6925 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:58.141581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:58.142232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:58.142511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:58.142784 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:58.151285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:58.152843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c777-03b0-4595-8b28-db4b67199ef5 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:58.160991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1131/2253] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 14:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:59:59.265116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:59:59.281064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18474-249a-4ef5-bf43-7bba5cc064db None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:59:59.285455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:59:59.286606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:59:59.287136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:59:59.287636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:59:59.298042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:59:59.299582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0abc-5d42-48c4-bb2e-440b385fad83 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:59:59.310257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1123/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 14:59:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:00:12.316362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0c18-8e63-4e86-8f66-8306a8264f5a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:00:12.316961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0c18-8e63-4e86-8f66-8306a8264f5a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:00:12.316961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0c18-8e63-4e86-8f66-8306a8264f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:00:12.338134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-908a0c18-8e63-4e86-8f66-8306a8264f5a None None] MFA Rules not processed for user `d677d0933a2f4a05895b92165d857d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:00:12.339447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-908a0c18-8e63-4e86-8f66-8306a8264f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:00:12.397580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1132/2255] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:00:12.660502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:00:12.661069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:00:12.661169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:00:12.682272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] MFA Rules not processed for user `ed75e7f09b1d4b60b45f7b024de32683`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:00:12.683949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:00:12.754412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1124/2256] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:00:22.047080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ba5b-c813-47e4-926a-f59728a6f9e0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:00:22.047558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ba5b-c813-47e4-926a-f59728a6f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:00:22.047676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ba5b-c813-47e4-926a-f59728a6f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:00:22.072305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9618ba5b-c813-47e4-926a-f59728a6f9e0 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:00:22.073833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9618ba5b-c813-47e4-926a-f59728a6f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:00:22.081926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1133/2257] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 15:00:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:00:22.094521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:00:22.106785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3af342-1f3a-461f-9b2c-ca68f704011f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:00:22.111886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:00:22.112522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:00:22.112807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:00:22.113085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:00:22.121846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:00:22.123452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5415e-ec43-4adc-a2e9-09d8f10282a2 service swift] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:00:22.131400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1125/2258] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:01:02.074856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:02.075929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:02.076389 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:02.105896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] MFA Rules not processed for user `27f80ce1149c4f01856d53fb6ae67291`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:02.107229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:02.160724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1134/2259] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:17.374602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:17.375125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:17.375125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:17.392016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] MFA Rules not processed for user `6239d81f06714c63ae74423b432ea583`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:17.393177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:17.448602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1126/2260] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:27.268470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:27.270490 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:27.337801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0809-40f5-4100-984d-80c4ff8a69c6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:27.342530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:27.343422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:27.343699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:27.343973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] PATH_INFO: `/v3/users/d677d0933a2f4a05895b92165d857d22` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:27.345145 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d677d0933a2f4a05895b92165d857d22)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:27.347074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:27.395518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd677d0933a2f4a05895b92165d857d22'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.398338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd677d0933a2f4a05895b92165d857d22'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.399203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd677d0933a2f4a05895b92165d857d22'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.415558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd677d0933a2f4a05895b92165d857d22'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.424410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd677d0933a2f4a05895b92165d857d22'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.443578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1135/2261] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:27 2022] DELETE /identity/v3/users/d677d0933a2f4a05895b92165d857d22 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:27.455064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:27.466423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc89b4-6e5d-4dd9-a16b-134e98ad1b9c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:27.543751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:27.545404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:27.546057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:27.546483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:27.549288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:27.632460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:27.633965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7c1ff-7dde-40ce-ba33-6333ee1f3610 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:27.644323 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1127/2262] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:01:27.811215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:27.812647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:27.829615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a6f0f-ec9a-4d8b-a6b5-ae4e5fefec9b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:27.834526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:27.835433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:27.835719 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:27.836040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] PATH_INFO: `/v3/projects/3956c3f25d4e496aaef3d83857fd310f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:27.837313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3956c3f25d4e496aaef3d83857fd310f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:27.840531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:27.890226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3956c3f25d4e496aaef3d83857fd310f', 'request_id': 'req-8ba2822b-637e-436e-baf1-7077d6575877'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.895912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3956c3f25d4e496aaef3d83857fd310f', 'request_id': 'req-8ba2822b-637e-436e-baf1-7077d6575877'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.902482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3956c3f25d4e496aaef3d83857fd310f', 'request_id': 'req-8ba2822b-637e-436e-baf1-7077d6575877'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.916568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] The token cache is being invalidate because project 3956c3f25d4e496aaef3d83857fd310f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:27.916877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.917502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ba2822b-637e-436e-baf1-7077d6575877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:27.919078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1136/2263] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:27 2022] DELETE /identity/v3/projects/3956c3f25d4e496aaef3d83857fd310f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:27.923935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:27.924231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:27.924514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:27.943405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:27.944657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:28.007215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1128/2264] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:01:28.014747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.015108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.015392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.033851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:28.035066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:28.043615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1137/2265] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:01:28.047805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.058036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2614-f929-45cd-8afa-96c8d585e1ec None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.062774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.063423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.063704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.063979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.064958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:28.065266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.066892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.080618 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1129/2266] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:28.084055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.094736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95534-04ee-4262-a87a-07f374ebcc33 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.100813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.101622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.101932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.102204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.102926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.104810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.132426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1138/2267] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:28.136681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.148033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ec482-717c-45e7-9502-e9f71c55dbca admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.204750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.205330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.205611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.205915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.206595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.208525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.229253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1130/2268] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:28.233323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.244103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be787-da4b-40ea-9ead-8dbabf3447f7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.248691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.249347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.249623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.249940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.250658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.252215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.263661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1139/2269] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:28.267761 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.278100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c23a-8a0d-4a06-9c15-e993e54065e0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.282642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.283286 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.283568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.283858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.284564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.286180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75802-eb32-45d1-a317-0d347ff0c697 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.296368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1131/2270] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:28.300266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.309861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383fd68-21f3-4471-a733-8f4178fe9981 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.314625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.315480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.315756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.316021 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] PATH_INFO: `/v3/projects/d543cd67a1fa49d68be58cee3bc98c10/users/95a211245aa849d8962283aeeb4a7c51/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.330080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d543cd67a1fa49d68be58cee3bc98c10, user_id=95a211245aa849d8962283aeeb4a7c51, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.332705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.345415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1140/2271] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:28 2022] PUT /identity/v3/projects/d543cd67a1fa49d68be58cee3bc98c10/users/95a211245aa849d8962283aeeb4a7c51/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:28.356030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.356314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.356589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.382339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] MFA Rules not processed for user `95a211245aa849d8962283aeeb4a7c51`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:28.383521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:28.449055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1132/2272] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:28.453536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.512953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7da7-0dfe-4674-9a99-1017f74081ed admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.517547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.518226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.518504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.518771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.519454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.521323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.546128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1141/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:28.550381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.561202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4c33c-c236-4ba2-8fb8-954dd9e5d595 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.614847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.615540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.615815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.616091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.616768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.618715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.639292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1133/2274] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:28.643154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.654326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eba26-1015-4e11-b752-24e90bd07e01 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.660053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.660881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.661173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.661573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.662571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.664299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.677709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1142/2275] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:28.680551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.690617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ca2e-4d13-426c-9288-05ae6a3669e7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.696257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.697136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.697415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.697721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] PATH_INFO: `/v3/projects/92480caab4244d5aad9c47fe43cfed16/users/e29c7238261c4b7c927c0a2d961d966a/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.713517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92480caab4244d5aad9c47fe43cfed16, user_id=e29c7238261c4b7c927c0a2d961d966a, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.716187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.729403 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1134/2276] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:28 2022] PUT /identity/v3/projects/92480caab4244d5aad9c47fe43cfed16/users/e29c7238261c4b7c927c0a2d961d966a/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:28.733343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.743095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f841-bf68-47ba-b159-bc8a255e06eb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.797668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.798342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.798650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.798894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.799609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.801187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8423f72-6095-46ef-bfc6-2e8fb7497e79 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.811783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1143/2277] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:01:28.816149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.826475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa37e4-7d0b-4e95-b6b6-ae1ca9981af6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:28.831135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:28.832018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.832298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.832573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] PATH_INFO: `/v3/projects/92480caab4244d5aad9c47fe43cfed16/users/e29c7238261c4b7c927c0a2d961d966a/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.837249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92480caab4244d5aad9c47fe43cfed16, user_id=e29c7238261c4b7c927c0a2d961d966a, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:28.837788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:28.848919 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1135/2278] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:28 2022] PUT /identity/v3/projects/92480caab4244d5aad9c47fe43cfed16/users/e29c7238261c4b7c927c0a2d961d966a/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:28.861989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:28.862290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:28.862582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:28.890272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] MFA Rules not processed for user `e29c7238261c4b7c927c0a2d961d966a`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:28.891640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:28.958130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1144/2279] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:28.970453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:28.972614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:29.050480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027a2d-fec1-46f1-8dc5-8f03ac362efd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:29.054704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:29.055355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:29.055640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:29.055920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:29.065224 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:29.066681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:29.076183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1136/2280] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:29.154290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:29.164931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203520a4-d888-4bfc-9b3f-70b7d6f8dda6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:29.168856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:29.169499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:29.169802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:29.170073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:29.228910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:29.230560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3fc1-5596-45ae-9b7b-7b03a5f359f0 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:29.250047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1145/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:30.537141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:30.538622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:30.620726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba92b-33ea-48d0-ac5a-76f94626f9ba service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:30.624533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:30.625184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:30.625485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:30.625770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:30.627850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:30.704011 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:30.705765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:30.716943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1137/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:30.776898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:30.777504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:30.777504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:30.795272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] MFA Rules not processed for user `ed75e7f09b1d4b60b45f7b024de32683`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:30.796482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:30.854284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1146/2283] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:34.294979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:34.303878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef1bb-5b2c-4aa4-9219-95200ee43346 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:34.307564 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:34.308196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:34.308480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:34.308754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:34.310496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:34.325240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:34.326728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1d68-d428-4113-aa5c-cf54d0311bd2 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:34.337998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1138/2284] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:44.112908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:44.172981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d05fd-563b-45e9-a5dc-5bcec0ab324f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:44.177524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:44.178521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:44.178801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:44.179078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] PATH_INFO: `/v3/users/95a211245aa849d8962283aeeb4a7c51` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:44.180269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a211245aa849d8962283aeeb4a7c51)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:44.182214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:44.230201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a211245aa849d8962283aeeb4a7c51'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:44.230859 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a211245aa849d8962283aeeb4a7c51'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:44.231454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a211245aa849d8962283aeeb4a7c51'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:44.243302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a211245aa849d8962283aeeb4a7c51'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:44.250454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a211245aa849d8962283aeeb4a7c51'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:44.263802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1147/2285] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:44 2022] DELETE /identity/v3/users/95a211245aa849d8962283aeeb4a7c51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:44.268240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:44.268746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:44.268854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:44.289396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:44.290635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:44.351009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1139/2286] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:44.360416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:44.362069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:44.418930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb39e18-5f73-44a6-ad7e-2b39b70e012f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:44.422604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:44.423243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:44.423523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:44.423819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:44.438442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:44.440134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:44.450205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1148/2287] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:01:45.173572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:45.175109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:45.204229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a554f-318f-464e-8e0b-37d4c7383311 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:45.209074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:45.209966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:45.210248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:45.210520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] PATH_INFO: `/v3/projects/d543cd67a1fa49d68be58cee3bc98c10` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:45.211718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d543cd67a1fa49d68be58cee3bc98c10)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:45.213797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:45.260482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd543cd67a1fa49d68be58cee3bc98c10', 'request_id': 'req-c1961d20-d051-4c63-b314-0a380425990b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.265958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd543cd67a1fa49d68be58cee3bc98c10', 'request_id': 'req-c1961d20-d051-4c63-b314-0a380425990b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.272167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd543cd67a1fa49d68be58cee3bc98c10', 'request_id': 'req-c1961d20-d051-4c63-b314-0a380425990b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.285006 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] The token cache is being invalidate because project d543cd67a1fa49d68be58cee3bc98c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:45.285295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.285941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.288290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1140/2288] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:45 2022] DELETE /identity/v3/projects/d543cd67a1fa49d68be58cee3bc98c10 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:45.292544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:45.302037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f08f0-933c-493e-a61b-66bac55a6f80 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:45.359651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:45.360558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:45.360837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:45.361111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] PATH_INFO: `/v3/users/e29c7238261c4b7c927c0a2d961d966a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:45.362307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29c7238261c4b7c927c0a2d961d966a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:45.364224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:45.411136 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29c7238261c4b7c927c0a2d961d966a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.412380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29c7238261c4b7c927c0a2d961d966a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.412992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29c7238261c4b7c927c0a2d961d966a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.424464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29c7238261c4b7c927c0a2d961d966a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.432149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-058adec3-5eff-4813-ad12-128bb399d522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29c7238261c4b7c927c0a2d961d966a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:45.445178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1149/2289] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:45 2022] DELETE /identity/v3/users/e29c7238261c4b7c927c0a2d961d966a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:45.863867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:45.865433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:45.908247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1961d20-d051-4c63-b314-0a380425990b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:45.971616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:45.972485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:45.972765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:45.973038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] PATH_INFO: `/v3/projects/92480caab4244d5aad9c47fe43cfed16` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:45.974458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92480caab4244d5aad9c47fe43cfed16)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:45.976520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.029748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92480caab4244d5aad9c47fe43cfed16', 'request_id': 'req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:46.035082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92480caab4244d5aad9c47fe43cfed16', 'request_id': 'req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:46.041920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92480caab4244d5aad9c47fe43cfed16', 'request_id': 'req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:46.056846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] The token cache is being invalidate because project 92480caab4244d5aad9c47fe43cfed16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:46.057183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:46.057931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c0a6482d-b2ce-4d04-a70b-59313b7c4b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:46.059774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1141/2290] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:45 2022] DELETE /identity/v3/projects/92480caab4244d5aad9c47fe43cfed16 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:46.065620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.065842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.066124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.086244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:46.087571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:46.152383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1150/2291] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:46.160297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.160854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.161297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.180303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:46.181521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:46.197100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1142/2292] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:01:46.198511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.208702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b46c-8069-4666-bcef-5662280fe784 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.214598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.215260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.215536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.215802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.216881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:46.216998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.218656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.236774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1151/2293] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:46.237991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.250649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f785921-9da0-46b1-85d0-5ec8b143cfe4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.256915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.257913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.258269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.258646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.259538 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.261432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.292908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1143/2294] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:46.295251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.309383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c416ad6-c0d2-4553-8b4a-d6e95c22dc7b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.375168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.375835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.376531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.376531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.377063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.378997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.404570 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1152/2295] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:46.405884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.417058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc54a-b243-4994-a2ac-650b875c887b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.422744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.423500 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.423874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.424226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.425071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.433774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.446875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1144/2296] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:46.450907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.461236 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cffe6-1d20-4813-a0a5-68be3f6125b5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.466123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.467157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.467438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.472191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.472191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.472191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772e54-88a8-4329-89e3-622379b62395 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.481731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1153/2297] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:01:46.485876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.497345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f60b-1168-4b2c-820b-1e0d48eed3a0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.502204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.503105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.503387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.503661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] PATH_INFO: `/v3/projects/024de904c66e491e8f884e3b5075eeb9/users/945e3afccc914d98be5629533ee85b23/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.518588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=024de904c66e491e8f884e3b5075eeb9, user_id=945e3afccc914d98be5629533ee85b23, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.521300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.537501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1145/2298] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:46 2022] PUT /identity/v3/projects/024de904c66e491e8f884e3b5075eeb9/users/945e3afccc914d98be5629533ee85b23/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:46.548685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.548925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.549201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.578587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] MFA Rules not processed for user `945e3afccc914d98be5629533ee85b23`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:46.580745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:46.644630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1154/2299] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:46.649197 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.712298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0236da-9f37-4b0a-8e16-622a78fc6cec admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.716974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.717635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.717934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.718203 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.718931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.720813 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.748160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1146/2300] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:46.752124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.763202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279fde-88b6-4f18-a329-ee260e43c16f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.820741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.821415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.821721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.821998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.822712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.824640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.848679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1155/2301] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:46 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:46.853074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.863991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fce66-cebb-4492-b3dd-16e901e0d22d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.868739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.869397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.869731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.870016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.870738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.872317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.883906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1147/2302] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:01:46.888242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.899569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491c2d-c865-4e40-b37e-5c54ec10b925 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:46.905417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:46.906494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:46.906774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:46.907040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] PATH_INFO: `/v3/projects/2ec8909f744f425c94a5aed99aeb5c85/users/546703e834334f72a0452a2e2d2f8996/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:46.923041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec8909f744f425c94a5aed99aeb5c85, user_id=546703e834334f72a0452a2e2d2f8996, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:46.925711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:46.939923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1156/2303] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:46 2022] PUT /identity/v3/projects/2ec8909f744f425c94a5aed99aeb5c85/users/546703e834334f72a0452a2e2d2f8996/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:46.944706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:46.953892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c1d2a-42a6-42cd-8e18-c2b567f9021f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.017353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.018064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.018344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.018617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.020281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.020940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aedf6-6e5d-4c4f-b660-6a67da8554b5 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.031147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1148/2304] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:47.035265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:47.045514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f5860-0c8c-4677-80e1-dc38dd6c8df5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.050176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.051060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.051338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.051735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] PATH_INFO: `/v3/projects/2ec8909f744f425c94a5aed99aeb5c85/users/546703e834334f72a0452a2e2d2f8996/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.054247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec8909f744f425c94a5aed99aeb5c85, user_id=546703e834334f72a0452a2e2d2f8996, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.060112 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.071732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1157/2305] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:47 2022] PUT /identity/v3/projects/2ec8909f744f425c94a5aed99aeb5c85/users/546703e834334f72a0452a2e2d2f8996/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:47.082869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.083247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.083600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.110298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] MFA Rules not processed for user `546703e834334f72a0452a2e2d2f8996`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:47.111510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:47.176868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1149/2306] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:47.188715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:47.190735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:47.246016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10333c0-01cf-49e9-a1e5-ceb4d3b61912 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.249595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.250250 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.250530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.250806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.259436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.260845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7be0c-b9f7-4ba6-96d6-d06f832292d7 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.269904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1158/2307] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:47.333542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:47.393598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74898-fdea-47d4-9b94-a0e2360fec3d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.399088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.399945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.400230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.400508 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] PATH_INFO: `/v3/users/945e3afccc914d98be5629533ee85b23` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.401851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=945e3afccc914d98be5629533ee85b23)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.403721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.449418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945e3afccc914d98be5629533ee85b23'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.450082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945e3afccc914d98be5629533ee85b23'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.450676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945e3afccc914d98be5629533ee85b23'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.462527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945e3afccc914d98be5629533ee85b23'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.469722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945e3afccc914d98be5629533ee85b23'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.483062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1150/2308] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:47 2022] DELETE /identity/v3/users/945e3afccc914d98be5629533ee85b23 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:47.487737 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.488189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.488284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.506589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:47.507760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:47.563480 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1159/2309] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:47.573947 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:47.575300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:47.632101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765ab46-af12-4436-9691-dfc55f5f3a4e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.637453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.638133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.638415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.638688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.648327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.649799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.659126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1151/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:47.915334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:47.916739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:47.929030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfc0c2-1d7d-4394-a257-b3db888175e6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:47.933598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:47.934475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:47.934754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:47.935025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] PATH_INFO: `/v3/projects/024de904c66e491e8f884e3b5075eeb9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:47.936209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024de904c66e491e8f884e3b5075eeb9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:47.938137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:47.985724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024de904c66e491e8f884e3b5075eeb9', 'request_id': 'req-ab4739d2-7a7c-4501-9498-c62da54ae329'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.991572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024de904c66e491e8f884e3b5075eeb9', 'request_id': 'req-ab4739d2-7a7c-4501-9498-c62da54ae329'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:47.997578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024de904c66e491e8f884e3b5075eeb9', 'request_id': 'req-ab4739d2-7a7c-4501-9498-c62da54ae329'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.011006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] The token cache is being invalidate because project 024de904c66e491e8f884e3b5075eeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:48.011298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.011912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.013437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1160/2311] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:47 2022] DELETE /identity/v3/projects/024de904c66e491e8f884e3b5075eeb9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:48.017401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.027156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e804a-651f-47cc-b7cb-d5c9293e9312 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.081297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.082181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.082461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.082733 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] PATH_INFO: `/v3/users/546703e834334f72a0452a2e2d2f8996` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.084020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546703e834334f72a0452a2e2d2f8996)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.086027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.129599 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546703e834334f72a0452a2e2d2f8996'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.130186 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546703e834334f72a0452a2e2d2f8996'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.131133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546703e834334f72a0452a2e2d2f8996'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.142302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546703e834334f72a0452a2e2d2f8996'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.149367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-36856776-217f-4f58-8443-f8b060f347a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546703e834334f72a0452a2e2d2f8996'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.161003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1152/2312] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:48 2022] DELETE /identity/v3/users/546703e834334f72a0452a2e2d2f8996 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:48.425957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.430843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:48.444160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4739d2-7a7c-4501-9498-c62da54ae329 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.500439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.501294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.501571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.501874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] PATH_INFO: `/v3/projects/2ec8909f744f425c94a5aed99aeb5c85` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.503037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec8909f744f425c94a5aed99aeb5c85)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.504908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.548584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec8909f744f425c94a5aed99aeb5c85', 'request_id': 'req-fc95af60-b3a2-43c6-b350-04f614956d9d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.554095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec8909f744f425c94a5aed99aeb5c85', 'request_id': 'req-fc95af60-b3a2-43c6-b350-04f614956d9d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.559902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec8909f744f425c94a5aed99aeb5c85', 'request_id': 'req-fc95af60-b3a2-43c6-b350-04f614956d9d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.571763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] The token cache is being invalidate because project 2ec8909f744f425c94a5aed99aeb5c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:48.572045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.572675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fc95af60-b3a2-43c6-b350-04f614956d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:48.574211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1161/2313] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:48 2022] DELETE /identity/v3/projects/2ec8909f744f425c94a5aed99aeb5c85 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:48.579114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.579624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.579722 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.600133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:48.601328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:48.657675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1153/2314] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:01:48.665857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.666146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.666424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.684261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:48.685438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:48.694173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1162/2315] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:48.698423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.707956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7d0bf-a1aa-4ab8-8697-b30f2599fe49 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.713553 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.714214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.714516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.714806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.715517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:48.715816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.717381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.728610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1154/2316] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:48.732924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.742464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224c86-ff9c-4db1-af80-c94ed905698c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.747097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.747732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.748007 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.748276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.748947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.750855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.776513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1163/2317] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:48 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:48.780319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.790364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72d15-2c93-4fa6-aa44-37cd04fa4969 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.844018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.844664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.844942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.845215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.845921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.847795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.878853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1155/2318] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:48 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:48.880032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.891079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33754fc-f231-4066-8188-2e31034c8756 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.895847 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.897079 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.897446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.897750 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.898472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.900051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.910242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1164/2319] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:48.914173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.923958 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a625ea-b4de-4a9e-af76-2af10db9f645 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.928525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.929173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.929455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.929766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.930554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.932146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6282e-5b9f-45ae-bf03-352e56190e33 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.942332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1156/2320] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:48.947196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:48.957033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7c53a-bf9b-4a1e-93fd-eda116e1514c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:48.962482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:48.963355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:48.963633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:48.963907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] PATH_INFO: `/v3/projects/403de319043a418fb7b3f0eec3af7791/users/87f14a21a4664691b1e817a9e1934a79/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:48.978204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403de319043a418fb7b3f0eec3af7791, user_id=87f14a21a4664691b1e817a9e1934a79, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:48.980839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:48.993056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1165/2321] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:48 2022] PUT /identity/v3/projects/403de319043a418fb7b3f0eec3af7791/users/87f14a21a4664691b1e817a9e1934a79/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:49.004307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.004632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.004911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.031504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] MFA Rules not processed for user `87f14a21a4664691b1e817a9e1934a79`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:49.032690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:49.094938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1157/2322] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:49.099671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.159283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9dd6a-231b-4e1f-9675-2a5e7a951267 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.164425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.165060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.165337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.165605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.166309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.168176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.194115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1166/2323] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:49 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:49.198063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.208736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e4b67-ff18-4c81-a690-4bd039d02c2f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.263205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.263856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.264139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.264414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.265097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.267027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.285636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1158/2324] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:49 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:49.290015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.299794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4ef1-9855-4e26-9841-901d95fcab83 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.305005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.305679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.305945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.306215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.306925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.308485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.319527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1167/2325] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:49.323444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.333127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0645-88a6-4592-807c-6e3305122ec3 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.337856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.338714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.338997 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.339274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] PATH_INFO: `/v3/projects/c20f45ba0fb0476c882d15aceea072eb/users/195cd65d05a8436aad94ed3c8ad4133d/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.353459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f45ba0fb0476c882d15aceea072eb, user_id=195cd65d05a8436aad94ed3c8ad4133d, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.356200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.369424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1159/2326] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:49 2022] PUT /identity/v3/projects/c20f45ba0fb0476c882d15aceea072eb/users/195cd65d05a8436aad94ed3c8ad4133d/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:49.373338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.383920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950046-e218-41ab-b1a5-7039551a9f19 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.437072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.437761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.438039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.438308 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.439013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.440829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7d806-2f40-4bb4-a7e1-ecd9ef3e88ce admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.450995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1168/2327] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:49.455064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.465465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab998452-76ca-45bb-9fce-e51f7e3f9c0d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.470072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.471029 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.471310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.471581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] PATH_INFO: `/v3/projects/c20f45ba0fb0476c882d15aceea072eb/users/195cd65d05a8436aad94ed3c8ad4133d/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.473537 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f45ba0fb0476c882d15aceea072eb, user_id=195cd65d05a8436aad94ed3c8ad4133d, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.477142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.487208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1160/2328] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:49 2022] PUT /identity/v3/projects/c20f45ba0fb0476c882d15aceea072eb/users/195cd65d05a8436aad94ed3c8ad4133d/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:49.498454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.498735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.499008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.524291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] MFA Rules not processed for user `195cd65d05a8436aad94ed3c8ad4133d`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:49.525458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:49.589518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1169/2329] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:49.601994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.603757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:49.658833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57496093-9dce-4d26-a47a-5c625be7dbca admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.663094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.663721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.664004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.664283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.673031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.674474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:49.684251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1161/2330] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:49.977264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:49.986228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046c18-6e89-4545-bf50-b435a70845c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:49.991000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195cd65d05a8436aad94ed3c8ad4133d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20f45ba0fb0476c882d15aceea072eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:49.991648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:49.991935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:49.992210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:49.992929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:49.993234 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:49.994864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.006260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1170/2331] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:50.010380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:50.019663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e044-3811-4d13-88b9-283e3e7167ad service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:50.024992 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195cd65d05a8436aad94ed3c8ad4133d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20f45ba0fb0476c882d15aceea072eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:50.025655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.025950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.026230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.026910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:50.028789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.055118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1162/2332] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:50 2022] POST /identity/v3/projects => generated 352 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:50.059152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:50.069092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed15bc-0dfe-4a41-8975-f0209659b660 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:50.122446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195cd65d05a8436aad94ed3c8ad4133d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20f45ba0fb0476c882d15aceea072eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:50.123102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.123388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.123670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.124381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:50.124688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:50.126319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.137509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1171/2333] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:50.172954 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:50.183121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50bdc-a0bd-4e40-b6f5-79c4e8051933 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:50.187801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195cd65d05a8436aad94ed3c8ad4133d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20f45ba0fb0476c882d15aceea072eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:50.188634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.188915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.189443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] PATH_INFO: `/v3/projects/e6edc84baa5a4bec9a9e8ccf73a90270` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.190639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e6edc84baa5a4bec9a9e8ccf73a90270)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:50.192528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.237000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6edc84baa5a4bec9a9e8ccf73a90270', 'request_id': 'req-9dd52850-c913-4084-9aee-6e04eafb8e69'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.242087 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6edc84baa5a4bec9a9e8ccf73a90270', 'request_id': 'req-9dd52850-c913-4084-9aee-6e04eafb8e69'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.247909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6edc84baa5a4bec9a9e8ccf73a90270', 'request_id': 'req-9dd52850-c913-4084-9aee-6e04eafb8e69'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.260350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] The token cache is being invalidate because project e6edc84baa5a4bec9a9e8ccf73a90270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:50.260629 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.261243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dd52850-c913-4084-9aee-6e04eafb8e69 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.262799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1163/2334] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:50 2022] DELETE /identity/v3/projects/e6edc84baa5a4bec9a9e8ccf73a90270 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:50.443754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:50.445504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:50.508789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebec4-97f5-43bb-947e-6476aa152699 tempest-VolumeQuotaClassesTest-1141601991 tempest-VolumeQuotaClassesTest-1141601991-project-admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:50.561413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:50.562299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.562574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.562840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] PATH_INFO: `/v3/users/87f14a21a4664691b1e817a9e1934a79` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.563989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f14a21a4664691b1e817a9e1934a79)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:50.566152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.610267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f14a21a4664691b1e817a9e1934a79'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.610907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f14a21a4664691b1e817a9e1934a79'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.611494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f14a21a4664691b1e817a9e1934a79'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.622497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f14a21a4664691b1e817a9e1934a79'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.630008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f14a21a4664691b1e817a9e1934a79'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:50.641625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1172/2335] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:50 2022] DELETE /identity/v3/users/87f14a21a4664691b1e817a9e1934a79 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:50.646981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.647480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.647480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.665001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:50.666209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:50.722772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1164/2336] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:01:50.732969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:50.734354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:50.789050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e95c-3e93-47f7-bad6-5a5084ce2c84 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:50.792599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:50.793227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:50.793506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:50.793811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:50.802618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:50.803969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:50.813048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1173/2337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:51.074035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:51.075436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:51.100793 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f03b3d-e444-4d7b-92ec-cdb962e01fab None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:51.105352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:51.106240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:51.106516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:51.106786 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] PATH_INFO: `/v3/projects/403de319043a418fb7b3f0eec3af7791` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:51.107944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403de319043a418fb7b3f0eec3af7791)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:51.109854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:51.155539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403de319043a418fb7b3f0eec3af7791', 'request_id': 'req-83a02d8c-d074-4e50-9368-1cf65ba785d1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.161146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403de319043a418fb7b3f0eec3af7791', 'request_id': 'req-83a02d8c-d074-4e50-9368-1cf65ba785d1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.167922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403de319043a418fb7b3f0eec3af7791', 'request_id': 'req-83a02d8c-d074-4e50-9368-1cf65ba785d1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.180994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] The token cache is being invalidate because project 403de319043a418fb7b3f0eec3af7791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:51.181275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.181929 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.184294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1165/2338] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:51 2022] DELETE /identity/v3/projects/403de319043a418fb7b3f0eec3af7791 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:51.187837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:51.198285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686e99-a4a5-441c-bbbd-9a768d6d8477 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:51.251116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:51.251972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:51.252251 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:51.252525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] PATH_INFO: `/v3/users/195cd65d05a8436aad94ed3c8ad4133d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:51.253739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195cd65d05a8436aad94ed3c8ad4133d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:51.256158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:51.306216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195cd65d05a8436aad94ed3c8ad4133d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.306941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195cd65d05a8436aad94ed3c8ad4133d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.307573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195cd65d05a8436aad94ed3c8ad4133d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.320808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195cd65d05a8436aad94ed3c8ad4133d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.337210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0d6245c3-e1cc-403d-a802-75c9f1acc406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195cd65d05a8436aad94ed3c8ad4133d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.349720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1174/2339] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:51 2022] DELETE /identity/v3/users/195cd65d05a8436aad94ed3c8ad4133d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:51.665880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:51.667440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:51.682611 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a02d8c-d074-4e50-9368-1cf65ba785d1 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:51.745084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:51.745974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:51.746254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:51.746530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] PATH_INFO: `/v3/projects/c20f45ba0fb0476c882d15aceea072eb` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:51.747715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20f45ba0fb0476c882d15aceea072eb)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:51.749608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:51.804257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20f45ba0fb0476c882d15aceea072eb', 'request_id': 'req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.809471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20f45ba0fb0476c882d15aceea072eb', 'request_id': 'req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.815872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20f45ba0fb0476c882d15aceea072eb', 'request_id': 'req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.829688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] The token cache is being invalidate because project c20f45ba0fb0476c882d15aceea072eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:51.829912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.830529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-48e0e2c2-c28e-40b3-abcf-1d9562a20d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:51.832091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1166/2340] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:51 2022] DELETE /identity/v3/projects/c20f45ba0fb0476c882d15aceea072eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:51.838387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:51.839200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:51.839362 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:51.859995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:51.861196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:51.930075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1175/2341] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:51.939620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:51.939912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:51.940184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:51.963569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:51.964778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:51.972888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1167/2342] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:51.978223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:51.994665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde48ad-28ad-40fa-a26c-08ff985b074e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:51.999431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.000090 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.000368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.000641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.001365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:52.001701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.003370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.017687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1176/2343] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:52.026064 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.035653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a551a-e05c-4eea-a9fc-91b06de3ed57 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.040528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.041174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.041455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.041768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.042527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.044428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.071381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1168/2344] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:52.075615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.085563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75b2f-45e1-4627-b4f7-2145699c3068 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.141494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.142242 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.142526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.142802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.143476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.145418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.164628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1177/2345] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:52.168833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.179917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4760-9bef-4df9-a843-5c17178750d2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.184513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.185163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.185450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.185757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.186476 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.188131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.199326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1169/2346] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:52.203348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.213317 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266c8-966a-4e44-8212-70bf4cb77ce3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.217993 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.218642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.218921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.219194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.219913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.221486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7f86d-946b-4687-9028-860c91b59192 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.231062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1178/2347] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:52.235056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.245425 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f9439-0747-4f68-a21f-3e608f4a8caf admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.249985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.250846 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.251125 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.251398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] PATH_INFO: `/v3/projects/c0032ecd5c36439793de2a03c5e49d5c/users/6b429c743fce497d860d73e1abe17258/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.266533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0032ecd5c36439793de2a03c5e49d5c, user_id=6b429c743fce497d860d73e1abe17258, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.269166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.281740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1170/2348] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:52 2022] PUT /identity/v3/projects/c0032ecd5c36439793de2a03c5e49d5c/users/6b429c743fce497d860d73e1abe17258/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:52.292884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.293174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.293452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.321166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] MFA Rules not processed for user `6b429c743fce497d860d73e1abe17258`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:52.322402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:52.386501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1179/2349] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:52.390991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.454995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659d6-7233-41e4-b25a-8f903e39cb4e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.459939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.460593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.460878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.461181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.461897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.464123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.494280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1171/2350] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:01:52.495449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.505850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fce33-e78d-4c69-9020-6a767e13ac4b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.558736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.559397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.559681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.559965 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.560636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.562583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.581798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1180/2351] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:52.585828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.595932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5167895-4da7-46a4-a1cb-0ee0dee8de32 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.601053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.601738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.602023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.602300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.603013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.604590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.615390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1172/2352] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:52.619444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.629108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778091-c9bd-4539-a5c4-425e004f2eb8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.633956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.634881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.635159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.635437 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] PATH_INFO: `/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1/users/f939ac7fbd0d44ce80d7ca37457c85bc/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.649851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b6deef2f824184b2896d57dc3b4ab1, user_id=f939ac7fbd0d44ce80d7ca37457c85bc, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.652469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.665264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1181/2353] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:52 2022] PUT /identity/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1/users/f939ac7fbd0d44ce80d7ca37457c85bc/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:52.669159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.680318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417ac5-6f50-4186-a796-a1c714de3efc admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.735073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.735729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.736005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.736277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.736985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.738592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f6051-08e9-4c29-a9de-8ae5dbd369d8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.749141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1173/2354] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:52.753229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.763416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bada7-fe4a-4a00-a9b4-d461b51bf4a4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.767982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.768853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.769134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.769409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] PATH_INFO: `/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1/users/f939ac7fbd0d44ce80d7ca37457c85bc/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.771406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b6deef2f824184b2896d57dc3b4ab1, user_id=f939ac7fbd0d44ce80d7ca37457c85bc, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.774050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.783879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1182/2355] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:52 2022] PUT /identity/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1/users/f939ac7fbd0d44ce80d7ca37457c85bc/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:52.794549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.794835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.795111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.821558 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] MFA Rules not processed for user `f939ac7fbd0d44ce80d7ca37457c85bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:52.822764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:52.886852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1174/2356] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:52.897959 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:52.899764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:52.955248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea126ee-b5df-4afe-b3b7-f6ce92852401 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:52.959535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:52.960158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:52.960435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:52.960702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:52.969472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:52.971028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:52.980763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1183/2357] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:53.076227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:53.086115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b70c3-9d11-4738-aa0d-1c6209caea8f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:53.089741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:53.090374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:53.090654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:53.090928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:53.144637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:53.146700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde4f1-5008-40c2-a7ba-caeded6fa891 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:53.155510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1175/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:55.690748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:55.749663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2eb49-4147-47ba-87aa-727efef2736f service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:55.754165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:55.755044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:55.755345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:55.755627 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] PATH_INFO: `/v3/users/6b429c743fce497d860d73e1abe17258` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:55.756790 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b429c743fce497d860d73e1abe17258)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:55.758721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:55.803390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b429c743fce497d860d73e1abe17258'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:55.804035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b429c743fce497d860d73e1abe17258'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:55.804625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b429c743fce497d860d73e1abe17258'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:55.815785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b429c743fce497d860d73e1abe17258'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:55.822796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b429c743fce497d860d73e1abe17258'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:55.835551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1184/2359] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:55 2022] DELETE /identity/v3/users/6b429c743fce497d860d73e1abe17258 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:55.840031 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:55.840492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:55.840586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:55.857910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:55.859112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:55.916782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1176/2360] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:55.926472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:55.928230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:55.987563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56ff47-a02b-44e0-94ae-4aec5b74cb60 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:55.991323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:55.991985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:55.992279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:55.992550 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:56.001258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:56.002702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:56.012049 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1185/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:56.269906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:56.271965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:56.284798 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6fcb-39c3-461c-bced-13f750e52e76 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:56.290408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:56.291254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:56.291535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:56.291806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] PATH_INFO: `/v3/projects/c0032ecd5c36439793de2a03c5e49d5c` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:56.293109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0032ecd5c36439793de2a03c5e49d5c)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:56.295714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:56.342039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0032ecd5c36439793de2a03c5e49d5c', 'request_id': 'req-ab6c4544-a8f6-4126-a5b1-4590271b5980'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.347191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0032ecd5c36439793de2a03c5e49d5c', 'request_id': 'req-ab6c4544-a8f6-4126-a5b1-4590271b5980'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.353231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0032ecd5c36439793de2a03c5e49d5c', 'request_id': 'req-ab6c4544-a8f6-4126-a5b1-4590271b5980'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.365325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] The token cache is being invalidate because project c0032ecd5c36439793de2a03c5e49d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:56.365686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.366307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.367872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1177/2362] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:56 2022] DELETE /identity/v3/projects/c0032ecd5c36439793de2a03c5e49d5c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:56.371964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:56.382272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863683a-18b1-470c-8ccf-0d9ca40af789 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:56.437304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:56.438246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:56.438530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:56.438808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] PATH_INFO: `/v3/users/f939ac7fbd0d44ce80d7ca37457c85bc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:56.440337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f939ac7fbd0d44ce80d7ca37457c85bc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:56.442277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:56.488343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f939ac7fbd0d44ce80d7ca37457c85bc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.488987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f939ac7fbd0d44ce80d7ca37457c85bc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.489950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f939ac7fbd0d44ce80d7ca37457c85bc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.501203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f939ac7fbd0d44ce80d7ca37457c85bc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.509119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8fec678a-8ad8-431b-85a9-f7411390cfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f939ac7fbd0d44ce80d7ca37457c85bc'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.521796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1186/2363] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:01:56 2022] DELETE /identity/v3/users/f939ac7fbd0d44ce80d7ca37457c85bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:01:56.780167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:56.781737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:56.794962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c4544-a8f6-4126-a5b1-4590271b5980 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:56.849964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:56.850837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:56.851113 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:56.851385 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] PATH_INFO: `/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:56.852534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b6deef2f824184b2896d57dc3b4ab1)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:56.854453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:56.899205 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b6deef2f824184b2896d57dc3b4ab1', 'request_id': 'req-013b9b58-2ed8-4f5e-b88e-ad821fc56568'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.904305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b6deef2f824184b2896d57dc3b4ab1', 'request_id': 'req-013b9b58-2ed8-4f5e-b88e-ad821fc56568'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.910164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b6deef2f824184b2896d57dc3b4ab1', 'request_id': 'req-013b9b58-2ed8-4f5e-b88e-ad821fc56568'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.922076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] The token cache is being invalidate because project c4b6deef2f824184b2896d57dc3b4ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:01:56.922354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.922955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-013b9b58-2ed8-4f5e-b88e-ad821fc56568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:01:56.924456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1178/2364] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:01:56 2022] DELETE /identity/v3/projects/c4b6deef2f824184b2896d57dc3b4ab1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:56.930495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:56.930966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:56.931081 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:56.949459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:56.950676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:57.008919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1187/2365] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:57.016826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.017140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.017413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.035655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:57.036805 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:57.044408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1179/2366] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:57.048468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.058468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b596e8-bca9-43ae-8f19-3f88a921a50a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.063016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.063661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.063936 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.064473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.065180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:01:57.065479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.067096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.078693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1188/2367] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:01:57.082957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.092423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5de75d-1888-43a2-8e96-c325f89563ff None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.096963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.097592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.097901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.098169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.098888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.100746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.124686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1180/2368] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:01:57 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:57.128714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.139174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944f37-dd7c-4262-a536-aef5843b51b4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.193188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.193886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.194170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.194447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.195131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.197032 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.215760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1189/2369] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:01:57 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:01:57.219772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.229797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881edb7-19aa-4575-8549-5aa5c0142cf0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.234256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.234893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.235170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.235439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.236144 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.237751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.248023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1181/2370] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:57.251801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.261950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4c8c-caad-4770-a376-ac2a7ff303a8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.266493 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.267129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.267407 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.267677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.268387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.270010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669928e-7b1e-4dd5-b675-5e25eec31652 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.280097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1190/2371] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:01:57.283877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.293459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c42f4-9793-425d-b395-212563314385 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.297885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.298727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.299003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.299272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] PATH_INFO: `/v3/projects/7181be2107394c3ba9f0e95a17c3d22b/users/262d7be8684847759ac8979dc3e9870b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.314336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7181be2107394c3ba9f0e95a17c3d22b, user_id=262d7be8684847759ac8979dc3e9870b, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.317038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.330107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1182/2372] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:01:57 2022] PUT /identity/v3/projects/7181be2107394c3ba9f0e95a17c3d22b/users/262d7be8684847759ac8979dc3e9870b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:01:57.341232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.341520 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.341843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.368100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] MFA Rules not processed for user `262d7be8684847759ac8979dc3e9870b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:01:57.369318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:57.430605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1191/2373] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:01:57.441299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:57.442957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:57.498334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4eb34-5b51-484f-b831-9cb8ab4248cd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:57.502051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:57.502688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:57.502972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:57.503241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:57.511350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:57.512788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:57.521884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1183/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:01:58.683031 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:01:58.684544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:58.754973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c6c11-71a3-4464-b4ed-e1c58033841c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:01:58.760703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:01:58.761347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:01:58.761629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:01:58.761957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:01:58.763683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:01:58.819768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:01:58.821337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a0794-2397-4a94-87c1-771012a939c2 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:01:58.830543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1192/2375] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:04.870572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:04.930580 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a816ec-07d4-4adb-9170-3503a0bf373f service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:04.935022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:04.935873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:04.936156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:04.936433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] PATH_INFO: `/v3/users/262d7be8684847759ac8979dc3e9870b` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:04.937608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] RBAC: Authorizing `identity:delete_user(user_id=262d7be8684847759ac8979dc3e9870b)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:04.939788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:04.983598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262d7be8684847759ac8979dc3e9870b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:04.984169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262d7be8684847759ac8979dc3e9870b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:04.984775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262d7be8684847759ac8979dc3e9870b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:04.996549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262d7be8684847759ac8979dc3e9870b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.008931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262d7be8684847759ac8979dc3e9870b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.022710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1184/2376] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:04 2022] DELETE /identity/v3/users/262d7be8684847759ac8979dc3e9870b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:05.027204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0767-e852-4001-924b-32408b287c4b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.027681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0767-e852-4001-924b-32408b287c4b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.027775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0767-e852-4001-924b-32408b287c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.045502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b72c0767-e852-4001-924b-32408b287c4b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:05.046731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b72c0767-e852-4001-924b-32408b287c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:05.105674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1193/2377] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:05.116090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.117480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:05.172892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1320-bbd5-46fa-b3ec-db6454f2599d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.176436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.177098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.177374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.177665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.186289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.187696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a01089-c7e2-4002-a8a1-2698214a178f service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.197693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1185/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:05.456938 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c0767-e852-4001-924b-32408b287c4b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.458994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b72c0767-e852-4001-924b-32408b287c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:05.470802 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c0767-e852-4001-924b-32408b287c4b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.475881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.476746 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.477026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.477301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] PATH_INFO: `/v3/projects/7181be2107394c3ba9f0e95a17c3d22b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.478601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7181be2107394c3ba9f0e95a17c3d22b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.480636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.526606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7181be2107394c3ba9f0e95a17c3d22b', 'request_id': 'req-db4c9564-6613-4a33-a983-222837123ad7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.531657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7181be2107394c3ba9f0e95a17c3d22b', 'request_id': 'req-db4c9564-6613-4a33-a983-222837123ad7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.538263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7181be2107394c3ba9f0e95a17c3d22b', 'request_id': 'req-db4c9564-6613-4a33-a983-222837123ad7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.549955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] The token cache is being invalidate because project 7181be2107394c3ba9f0e95a17c3d22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:05.550233 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.550831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-db4c9564-6613-4a33-a983-222837123ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:05.553468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1194/2379] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:05 2022] DELETE /identity/v3/projects/7181be2107394c3ba9f0e95a17c3d22b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:05.558305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.558623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.558900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.576123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:05.577300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:05.633514 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1186/2380] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:02:05.641087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.641397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.641696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.660098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:05.662367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:05.670074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1195/2381] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:05.674137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.683697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac0d2-5d12-49bd-a2ae-3bc0b0096166 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.688115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.688753 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.689027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.689562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.690305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:02:05.690608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.692196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.703573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1187/2382] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:02:05.707668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.717188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d4a7-0ec6-41d1-b44f-4a06497b1b93 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.721756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.722391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.722670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.722943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.724319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.726314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.754676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1196/2383] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:05.756207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.766017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13be7-53b7-41e0-810c-5a50b5f1ab15 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.822400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.822985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.823260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.823530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.824196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.826117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.845865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1188/2384] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:05.850687 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.860721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc571b9-bdd6-4159-b757-b710e241ae31 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.865296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.865964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.866240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.866511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.867224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.868796 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.878672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1197/2385] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:05.882395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.891935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9efe8-9a5e-4db0-8c99-8fd79442e303 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.897534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.898204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.898478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.898748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.899482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.901033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a75d-8e00-4b97-a3c3-e72258bd8d6b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.910792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1189/2386] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:05.915332 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:05.925034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3a6c-825f-40a5-82a1-812b4eca667e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:05.930077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:05.930946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.931228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.931502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] PATH_INFO: `/v3/projects/d27dd9c5ebb84b99920be751bf7885b0/users/0af229ea290a40d7b955b0555c714de4/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.946305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27dd9c5ebb84b99920be751bf7885b0, user_id=0af229ea290a40d7b955b0555c714de4, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:05.948939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:05.962314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1198/2387] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:05 2022] PUT /identity/v3/projects/d27dd9c5ebb84b99920be751bf7885b0/users/0af229ea290a40d7b955b0555c714de4/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:05.973504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:05.973826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:05.974105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:05.999578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] MFA Rules not processed for user `0af229ea290a40d7b955b0555c714de4`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:06.000764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:06.062967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1190/2388] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:06.074405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:06.076084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:06.131704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9882d97-e15f-4fde-a3a3-0ade8fdd18d8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:06.135354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:06.135991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:06.136268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:06.136539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:06.144756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:06.146752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:06.155500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1199/2389] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:12.107717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:12.109581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:12.170762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed31bb5-7450-458e-8c74-a7eb0c09b486 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:12.174946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:12.175764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:12.176200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:12.177271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:12.179648 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:12.189698 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:12.191122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f856dc-5a79-40c3-8a18-4786da2c3c4a service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:12.199953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1191/2390] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:02:15.719925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:15.721334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:15.733869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c534-f842-4971-ab2d-7917f98b52e6 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:15.737370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:15.738039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:15.738318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:15.738590 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:15.740414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:15.749273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:15.750703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625ec43-5909-4115-9807-7724b827cbf7 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:15.758704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1200/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:15.858573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4361-eb57-48a6-9f4a-b39b625e0f9e None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:15.859200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4361-eb57-48a6-9f4a-b39b625e0f9e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:15.859200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4361-eb57-48a6-9f4a-b39b625e0f9e None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:15.860730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1192/2392] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 15:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:02:15.866509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d209e-0ac0-4169-9610-5464c7b28a74 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:15.866795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d209e-0ac0-4169-9610-5464c7b28a74 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:15.867070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d209e-0ac0-4169-9610-5464c7b28a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:15.885036 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0d7d209e-0ac0-4169-9610-5464c7b28a74 None None] MFA Rules not processed for user `fb6e25f80f1b42b092c1ae964b179f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:15.886265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0d7d209e-0ac0-4169-9610-5464c7b28a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:15.892692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1201/2393] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 15:02:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:15.906865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4361-eb57-48a6-9f4a-b39b625e0f9e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:15.918682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4361-eb57-48a6-9f4a-b39b625e0f9e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:15.922225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:15.922865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:15.923146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:15.923420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:15.931344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:15.932694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f7ed-22e3-4961-b967-8aa11a518cee service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:15.941060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1193/2394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:16.046464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c1f2-2b22-4df9-9078-3e6c76bee5d4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.046730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c1f2-2b22-4df9-9078-3e6c76bee5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.047060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c1f2-2b22-4df9-9078-3e6c76bee5d4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.048365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1202/2395] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 15:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:02:16.053249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.053536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.053837 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.071853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:16.073067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.137985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1194/2396] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:16.149829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c1f2-2b22-4df9-9078-3e6c76bee5d4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:16.160300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c1f2-2b22-4df9-9078-3e6c76bee5d4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:16.163891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:16.164542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.164815 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.165082 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.175548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:16.177409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:16.187778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:16.188117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1203/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:16.253121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:16.255097 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.256908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f8e1-8924-40a5-99cd-ab1ba09e5d4d None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:16.261387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:16.262269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.262544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.262811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] PATH_INFO: `/v3/users/0af229ea290a40d7b955b0555c714de4` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.264079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af229ea290a40d7b955b0555c714de4)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:16.266039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:16.311279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af229ea290a40d7b955b0555c714de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.311935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af229ea290a40d7b955b0555c714de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.312555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af229ea290a40d7b955b0555c714de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.323282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc562c-6893-42e6-af7d-e1a9819ef4ac service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:16.327097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af229ea290a40d7b955b0555c714de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.328461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:16.329096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.329373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.329656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.331512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.335727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-095afdab-3775-4e46-82b6-e4c5672780e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af229ea290a40d7b955b0555c714de4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.344529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:16.346149 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:16.347603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1195/2398] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:16 2022] DELETE /identity/v3/users/0af229ea290a40d7b955b0555c714de4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:16.352317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.352603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.352878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.356982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1204/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:02:16.369326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:16.370526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.434583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1196/2400] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:02:16.444930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:16.446642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.458863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601c31-496e-453c-bf50-2c7e4f1fc68d service placement] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:16.510695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:16.511368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.511685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.511952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.523462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:16.524884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb0a44-64e4-4b72-bbfd-67f6695791f1 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:16.535008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1205/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:16.813562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:16.815307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.828075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c0e37-633d-42e5-b39f-cd2a555c4ad0 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:16.832680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:16.833534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.833851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.834149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] PATH_INFO: `/v3/projects/d27dd9c5ebb84b99920be751bf7885b0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.835301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27dd9c5ebb84b99920be751bf7885b0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:16.837198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:16.882885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27dd9c5ebb84b99920be751bf7885b0', 'request_id': 'req-823b8252-073d-4d72-8da8-1693319d60d2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.888044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27dd9c5ebb84b99920be751bf7885b0', 'request_id': 'req-823b8252-073d-4d72-8da8-1693319d60d2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.893962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27dd9c5ebb84b99920be751bf7885b0', 'request_id': 'req-823b8252-073d-4d72-8da8-1693319d60d2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.906454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] The token cache is being invalidate because project d27dd9c5ebb84b99920be751bf7885b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:16.906738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.907348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-823b8252-073d-4d72-8da8-1693319d60d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:16.908884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1197/2402] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:16 2022] DELETE /identity/v3/projects/d27dd9c5ebb84b99920be751bf7885b0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:16.914325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:16.914770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:16.914891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:16.933166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:16.934387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:16.992160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1206/2403] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:16.999819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.000105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.000383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.018026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:17.019189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:17.034414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1198/2404] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:02:17.037477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.048296 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937289-bfbd-4156-9354-c31110f8d418 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.054084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.054821 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.055169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.055507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.056403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:02:17.056775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.058478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.071147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1207/2405] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:02:17.078703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.088234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471fb66-cb87-4d26-af08-d88cbe5d2efb None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.093040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.093794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.094169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.094456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.095171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.097057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.124488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1199/2406] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:17.128511 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.138662 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8a8-ee59-4ce7-b071-ddab4a42e1f6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.198521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.199185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.199460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.199725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.200386 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.202301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.222044 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1208/2407] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:17 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:17.226715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.236497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7291828-e436-4ce6-b2d0-18b96a1bb5bb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.241108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.241780 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.242061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.242384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.243043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.244617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.254737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1200/2408] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:17.258433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.267861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff8ebd-e763-443d-8446-c24c7fcc5818 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.273419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.274089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.274367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.274658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.275366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.276922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eef28-a3cc-4eea-8437-9bd8b5e58f16 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.287383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1209/2409] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:17.291271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.300758 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb8d83-5729-495c-89b6-cc9b5dc17d5e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.305930 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.306785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.307063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.307333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] PATH_INFO: `/v3/projects/d4af07bd8d7141af97fb4bf0e8168e9f/users/7f47adc5a3b44275b1f4a80033464768/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.322952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4af07bd8d7141af97fb4bf0e8168e9f, user_id=7f47adc5a3b44275b1f4a80033464768, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.325520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.338482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1201/2410] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:17 2022] PUT /identity/v3/projects/d4af07bd8d7141af97fb4bf0e8168e9f/users/7f47adc5a3b44275b1f4a80033464768/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:17.343514 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.343806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.344084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.361799 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:17.362981 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:17.418935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1210/2411] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:17.428607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.430350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:17.490777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cc00-cfb3-4c4b-ac98-dacb51abce02 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.494501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.495117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.495404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.495676 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.504616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.506182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cea1-35e8-4a2e-86f7-b88f74cb02a4 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.515660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1202/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:17.589040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:17.590572 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:17.688607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493975d-fefb-42db-9405-143422fc6b23 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:17.696525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:17.697246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:17.697526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:17.697867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:17.699652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:17.712708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:17.714398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:17.725554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1211/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:22.514447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.515615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.515615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.546201 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] MFA Rules not processed for user `7f47adc5a3b44275b1f4a80033464768`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:22.547437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:22.619027 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1203/2414] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:22.623722 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.635415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228def17-1251-4f75-b592-5156c24d14fc service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.640548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.641210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.641489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.641810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.642512 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.644403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.670948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1212/2415] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:22.675039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.686884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3823-d73a-45cf-9155-ff0b149e33f4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.744223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.744891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.745172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.745446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.746172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.748443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.770802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1204/2416] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:22 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:22.774854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.785241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8582-896c-4699-9d4d-2ac9e3430466 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.790524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.791569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.791569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.791789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.792448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.794099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.806193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1213/2417] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:02:22.810479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.821295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137de9-628a-42ee-ae74-7e9e7c32714c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.826056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.826948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.827233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.827511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] PATH_INFO: `/v3/projects/9fd84f07f7914bf399cf1c9c8de329df/users/6ee91e1e9cbe4780a6419b80d91773f6/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.844860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd84f07f7914bf399cf1c9c8de329df, user_id=6ee91e1e9cbe4780a6419b80d91773f6, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.848433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.861900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1205/2418] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:22 2022] PUT /identity/v3/projects/9fd84f07f7914bf399cf1c9c8de329df/users/6ee91e1e9cbe4780a6419b80d91773f6/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:22.866560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.876709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a9b0-389e-433f-a878-5e3dbbe34953 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.935072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.935735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.936011 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.936282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.936988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.938894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.948454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1214/2419] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:02:22.952631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:22.962892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54894-1a4d-4609-b711-b1339b346968 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:22.967497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:22.968359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:22.968640 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:22.968913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] PATH_INFO: `/v3/projects/9fd84f07f7914bf399cf1c9c8de329df/users/6ee91e1e9cbe4780a6419b80d91773f6/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:22.970879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd84f07f7914bf399cf1c9c8de329df, user_id=6ee91e1e9cbe4780a6419b80d91773f6, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:22.974034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545f4f-b488-4f30-b23c-8f31e949069a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:22.984039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1206/2420] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:22 2022] PUT /identity/v3/projects/9fd84f07f7914bf399cf1c9c8de329df/users/6ee91e1e9cbe4780a6419b80d91773f6/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:27.544869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:27.712678 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435964f6-2182-40a9-a72b-48bf4e793980 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:27.889498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:27.890454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:27.890906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:27.891348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:27.893382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:27.910331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:27.913040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:27.928465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1215/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:29.585501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:29.586121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:29.586664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:29.630441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] MFA Rules not processed for user `6ee91e1e9cbe4780a6419b80d91773f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:29.635454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:29.652050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:29.665705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187abd-9708-4e6a-b025-ae4833c25540 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:29.673343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:29.675053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:29.676696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:29.677189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:29.679323 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:29.736458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1207/2422] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:29.749013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:29.750577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:29.764943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:29.767117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd484-d17a-43a8-82be-a5780d20a1e4 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:29.780087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1216/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:29.867228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20525fa3-3be2-42bf-b9d5-09dfa95d1934 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:29.878233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:29.878998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:29.879239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:29.881009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:29.970994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:29.973225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:29.993869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1208/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:30.157822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:30.158293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:30.158727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:30.194904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:30.196469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:30.274594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1217/2425] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:30.357228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:30.358677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:30.487107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c739f9-ca50-483d-9359-00d3ea9e8f5d service glance] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:30.495885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:30.497346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:30.497766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:30.498116 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:30.510831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:30.513304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:30.523098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1209/2426] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:02:34.112434 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:34.243689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5b939-37d7-4127-81ef-8130b4dead99 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:34.253041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:34.260856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:34.262278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:34.262875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:34.266888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:34.406073 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:34.411194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:34.438152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1218/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:38.749532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:38.751937 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:38.792988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b0cc6-2769-4430-8dfc-17d81cf02ef1 service swift] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:38.798567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:38.800005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:38.800450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:38.800936 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] PATH_INFO: `/v3/users/27f80ce1149c4f01856d53fb6ae67291` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:38.802499 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f80ce1149c4f01856d53fb6ae67291)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:38.805020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:38.888468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f80ce1149c4f01856d53fb6ae67291'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:38.889271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f80ce1149c4f01856d53fb6ae67291'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:38.890058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f80ce1149c4f01856d53fb6ae67291'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:38.940215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f80ce1149c4f01856d53fb6ae67291'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:38.954059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-7b8270bc-7c7f-4851-bea0-4856cf5b8f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f80ce1149c4f01856d53fb6ae67291'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:38.968241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1210/2428] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:38 2022] DELETE /identity/v3/users/27f80ce1149c4f01856d53fb6ae67291 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:39.188894 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.202653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cc19-3c33-4f1e-a6f3-bb6f6e54b310 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.275727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.277491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.277819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.278105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] PATH_INFO: `/v3/projects/33c19e606db245779d45fb4204bbd588` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.279421 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c19e606db245779d45fb4204bbd588)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.281621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.354497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c19e606db245779d45fb4204bbd588', 'request_id': 'req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:39.361223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c19e606db245779d45fb4204bbd588', 'request_id': 'req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:39.369039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c19e606db245779d45fb4204bbd588', 'request_id': 'req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:39.387854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] The token cache is being invalidate because project 33c19e606db245779d45fb4204bbd588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:39.388213 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:39.388888 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ffc3ac4f-9b8d-4973-8f28-27e8e128b55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:39.390730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1219/2429] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:39 2022] DELETE /identity/v3/projects/33c19e606db245779d45fb4204bbd588 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:39.395673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.396547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.397066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.418010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:39.419492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:39.496260 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1211/2430] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:02:39.505161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.505508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.505761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.525691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:39.527489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:39.539716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1220/2431] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:39.541356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.552219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8ea4-8cbd-47ca-ae34-858952df309e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.557003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.557694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.558050 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.558329 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.559055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:02:39.559366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.560953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.580482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1212/2432] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:02:39.581211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.592715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8213-1cf7-4506-8e0f-91eebdab6288 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.598607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.599264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.599541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.599808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.600498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.602467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.658764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.670440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1221/2433] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:39 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:02:39.676376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4df2-7ba0-4364-9583-ad29eb4f77d0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.764017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.764729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.764975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.765250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.765994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.768565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.812259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1213/2434] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:39 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:39.816563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.829582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66dd9b-bdd6-410f-a5d1-45b8c768352d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.838324 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.839006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.839290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.839567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.841222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.844942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.862165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1222/2435] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:39.870236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.881932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8bea-d348-4050-b486-fd1bde404902 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.887065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.887850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.888265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.888651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.889464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.891241 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfbe78-eb38-4b7b-afd7-3696006b9db2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.907498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1214/2436] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:39.911904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:39.927307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2d491-57a5-4ca0-9557-f66c0d0a0596 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:39.936676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:39.937929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.938281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.938661 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] PATH_INFO: `/v3/projects/2ca89a3d8efe467ab7e81b1be57d390a/users/d9c3d1049d8047abbbbf2879a878403f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:39.964279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca89a3d8efe467ab7e81b1be57d390a, user_id=d9c3d1049d8047abbbbf2879a878403f, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:39.967600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:39.983997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1223/2437] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:39 2022] PUT /identity/v3/projects/2ca89a3d8efe467ab7e81b1be57d390a/users/d9c3d1049d8047abbbbf2879a878403f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:39.995597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0728-ddf8-4961-ba98-ac8c074eb472 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:39.995896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0728-ddf8-4961-ba98-ac8c074eb472 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:39.996326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0728-ddf8-4961-ba98-ac8c074eb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:40.029965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-f9cf0728-ddf8-4961-ba98-ac8c074eb472 None None] MFA Rules not processed for user `d9c3d1049d8047abbbbf2879a878403f`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:40.031274 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f9cf0728-ddf8-4961-ba98-ac8c074eb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:40.140574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1215/2438] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:40.199128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:40.201611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:40.364542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd863-e87a-46be-9b84-cadea3d94c30 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:40.371727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:40.372600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:40.372881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:40.373158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:40.383243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:40.384866 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:40.396952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1224/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:02:40.483934 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f32a7-01a0-42f5-b04b-da8ea2ab045a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:40.484225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f32a7-01a0-42f5-b04b-da8ea2ab045a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:40.484532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f32a7-01a0-42f5-b04b-da8ea2ab045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:40.505217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e44f32a7-01a0-42f5-b04b-da8ea2ab045a None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:40.506765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e44f32a7-01a0-42f5-b04b-da8ea2ab045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:40.580121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1216/2440] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:40.599219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:40.601013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:40.695248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748f8d-f354-4696-a750-9b598e721a23 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:40.700696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:40.701462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:40.701871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:40.702216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:40.714653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:40.716355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:40.725634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1225/2441] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:02:42.397678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020e9-58d3-4e23-ad9d-98eb6f6f1d59 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:42.398214 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020e9-58d3-4e23-ad9d-98eb6f6f1d59 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:42.398312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020e9-58d3-4e23-ad9d-98eb6f6f1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:42.423495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-9d3020e9-58d3-4e23-ad9d-98eb6f6f1d59 None None] MFA Rules not processed for user `7f47adc5a3b44275b1f4a80033464768`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:42.426704 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9d3020e9-58d3-4e23-ad9d-98eb6f6f1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:42.510970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1217/2442] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:44.064409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:44.078710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250a35-a4ec-4164-9a2b-92ad9e411534 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:44.090673 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:44.091622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:44.091909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:44.092239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:44.094607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:44.164607 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:44.166344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:44.175881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1226/2443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:02:46.733678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:46.734191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:46.734302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:46.756474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:46.757915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:46.771683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1218/2444] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:46.778783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:46.792676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f64c6-0a7d-4c98-9c00-7155249ef8cd service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:46.801104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:46.802057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:46.802461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:46.802834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:46.812912 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:46.815029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76113a-2072-4768-84e8-d5ffcf5fd11c service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:46.827307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1227/2445] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:02:48.966695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:49.094551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd629c-73fc-4ac2-80a7-f8ce2d67df9c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:49.108840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:49.110076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:49.110546 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:49.110984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] PATH_INFO: `/v3/users/d9c3d1049d8047abbbbf2879a878403f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:49.120857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c3d1049d8047abbbbf2879a878403f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:49.123126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:49.234604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c3d1049d8047abbbbf2879a878403f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:49.235279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c3d1049d8047abbbbf2879a878403f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:49.236095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c3d1049d8047abbbbf2879a878403f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:49.264239 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c3d1049d8047abbbbf2879a878403f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:49.297881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c3d1049d8047abbbbf2879a878403f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:49.334023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1219/2446] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:48 2022] DELETE /identity/v3/users/d9c3d1049d8047abbbbf2879a878403f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:49.338320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:49.339621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:49.340063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:49.361224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:49.362704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:49.509548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1228/2447] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:49.520808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:49.522180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:49.627127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f69e-89f5-4b1f-a7f5-473d8f801e0e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:49.639099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:49.640093 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:49.640534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:49.640978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:49.660477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:49.662225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:49.701809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1220/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:50.193406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:50.194878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:50.387271 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1bd42-d9ae-4625-a867-a53cc8f9f1d5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:50.421852 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:50.422989 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:50.423456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:50.423909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:50.439280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:50.497402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:50.505881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759154f5-f6e6-457f-a5ec-5bd9f19779a7 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:50.511271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:50.513289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:50.529988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1229/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:50.538332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2614-bec5-4e2c-a1e8-b040e6567cc3 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:50.555393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:50.556460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:50.556764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:50.557122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] PATH_INFO: `/v3/projects/2ca89a3d8efe467ab7e81b1be57d390a` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:50.558627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca89a3d8efe467ab7e81b1be57d390a)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:50.574801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:50.697163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca89a3d8efe467ab7e81b1be57d390a', 'request_id': 'req-812c6235-3b93-4cb8-9026-ba4c3601b4c1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:50.714887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca89a3d8efe467ab7e81b1be57d390a', 'request_id': 'req-812c6235-3b93-4cb8-9026-ba4c3601b4c1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:50.726779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca89a3d8efe467ab7e81b1be57d390a', 'request_id': 'req-812c6235-3b93-4cb8-9026-ba4c3601b4c1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:50.750594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] The token cache is being invalidate because project 2ca89a3d8efe467ab7e81b1be57d390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:50.751215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:50.752068 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-812c6235-3b93-4cb8-9026-ba4c3601b4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:50.755630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1221/2450] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:50 2022] DELETE /identity/v3/projects/2ca89a3d8efe467ab7e81b1be57d390a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:02:50.760714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:50.760845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:50.761115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:50.780985 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:50.783957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:50.973202 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1230/2451] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:50.981670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:50.982217 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:50.985881 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.023582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:51.025140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:51.035317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1222/2452] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:51.039423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.063069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af1a70-553f-4890-bd97-df0dd4256477 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.076708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.077764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.078945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.079403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.083103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:02:51.084460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.089695 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.117930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1231/2453] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:02:51.119976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.134572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e7103-fb66-454b-b850-5e1e56bc797a None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.148688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.149819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.150339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.150851 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.151800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.155970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.225759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1223/2454] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:51 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:02:51.229495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.242861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf74ea9-04bd-4e44-a700-cdc0b35a9e4c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.331464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.332606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.333143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.333896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.335277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.337504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.380028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1232/2455] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:51 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:51.382383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.400727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf269-fbdc-4602-8708-0193bca92428 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.413442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.415773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.418802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.437298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.439423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.448040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.490757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1224/2456] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:51.492070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.507196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1898-d446-495d-8527-921ce1cc7f7b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.515010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.516139 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.516706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.517544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.519612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.521826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94bc05-1d50-40dc-9402-6cd72475f12d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.533897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1233/2457] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:02:51.538511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:51.553701 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfc50-e6ec-4275-8bde-3a7f8370e3bf admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:51.560596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:51.561899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.562566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.563094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] PATH_INFO: `/v3/projects/0b07c80dd111484081c24b87a8476e92/users/400649435e7c4a9694262afe68fd0d75/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.605707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b07c80dd111484081c24b87a8476e92, user_id=400649435e7c4a9694262afe68fd0d75, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:51.611638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:51.651576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1225/2458] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:51 2022] PUT /identity/v3/projects/0b07c80dd111484081c24b87a8476e92/users/400649435e7c4a9694262afe68fd0d75/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:51.662263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:51.662916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:51.663428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:51.731854 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] MFA Rules not processed for user `400649435e7c4a9694262afe68fd0d75`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:51.733856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:51.935863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1234/2459] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:51.941630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.044891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd04-22e5-4e2f-aaea-9dac2eea909c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.058090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.059556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.060115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.060729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.061597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.064597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.142706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1226/2460] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:51 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:52.147269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.164440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0ed7-fb3a-4051-abb7-53346a314d52 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.335560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.336302 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.336591 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.337114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.337883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.350926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.389729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1235/2461] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:52 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:52.393204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.409921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca283f-b2ec-4ff3-9804-0eb58f136ab0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.419511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.422077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.423621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.424506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.428017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.433520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.456824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1227/2462] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:02:52.457282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.467879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645b3a-07c8-4940-a58a-56580dd19975 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.476968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.478303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.479000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.479508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] PATH_INFO: `/v3/projects/d6c0bbbede46452fad1619ab85d8ee95/users/9f289b9712614e5d8f4cf1c04f6aadad/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.499209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c0bbbede46452fad1619ab85d8ee95, user_id=9f289b9712614e5d8f4cf1c04f6aadad, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.503163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.522180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1236/2463] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:52 2022] PUT /identity/v3/projects/d6c0bbbede46452fad1619ab85d8ee95/users/9f289b9712614e5d8f4cf1c04f6aadad/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:52.525928 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.538650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9799d5-10f7-4828-8dc2-9413a5c8dc2d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.606036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.606831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.607220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.607619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.608675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.610582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef308be8-0573-46da-8719-a56847bdcfe0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.625307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1228/2464] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:52.626642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.660699 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b053a1-0250-4f6a-a416-bbaf99059ed0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:52.671752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:52.672864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.676147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.676606 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] PATH_INFO: `/v3/projects/d6c0bbbede46452fad1619ab85d8ee95/users/9f289b9712614e5d8f4cf1c04f6aadad/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.680025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c0bbbede46452fad1619ab85d8ee95, user_id=9f289b9712614e5d8f4cf1c04f6aadad, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:52.684252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:52.726357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1237/2465] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:52 2022] PUT /identity/v3/projects/d6c0bbbede46452fad1619ab85d8ee95/users/9f289b9712614e5d8f4cf1c04f6aadad/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:52.728153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:52.728451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:52.728755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:52.780612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] MFA Rules not processed for user `9f289b9712614e5d8f4cf1c04f6aadad`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:52.780612 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:52.887654 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1229/2466] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:52.899851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:52.902829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:52.999272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc230-aa9f-487d-bf41-78e8a399bc9c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:53.004855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:53.005476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:53.005803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:53.006089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:53.021999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:53.024243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b56513-5a5e-412f-a03b-f8bb641589bc service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:53.068756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1238/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:53.293941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:53.462916 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90173c7-f894-4336-9359-9f01939c20ee None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:53.476600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:53.478518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:53.478518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:53.478730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] PATH_INFO: `/v3/users/400649435e7c4a9694262afe68fd0d75` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:53.480710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400649435e7c4a9694262afe68fd0d75)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:53.483485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:53.610086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400649435e7c4a9694262afe68fd0d75'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:53.613510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400649435e7c4a9694262afe68fd0d75'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:53.614370 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400649435e7c4a9694262afe68fd0d75'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:53.630638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400649435e7c4a9694262afe68fd0d75'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:53.642432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400649435e7c4a9694262afe68fd0d75'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:53.656854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1230/2468] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:53 2022] DELETE /identity/v3/users/400649435e7c4a9694262afe68fd0d75 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:53.665774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:53.666337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:53.666337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:53.693957 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:53.695207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:53.780703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1239/2469] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:53.794420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:53.796272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:53.869466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11560e4-92f7-413a-9025-6fb2d79d41c7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:53.874461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:53.875540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:53.875835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:53.876112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:53.887680 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:53.890204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:53.906825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1231/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:54.305513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:54.307760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:54.326427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bd0fa-dd34-4d08-8589-f969296706d2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:54.332903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:54.334369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:54.334740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:54.335016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] PATH_INFO: `/v3/projects/0b07c80dd111484081c24b87a8476e92` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:54.336768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b07c80dd111484081c24b87a8476e92)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:54.342019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:54.393336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b07c80dd111484081c24b87a8476e92', 'request_id': 'req-3c0558a8-ac93-43af-9a14-5c90f3566f08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.399927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b07c80dd111484081c24b87a8476e92', 'request_id': 'req-3c0558a8-ac93-43af-9a14-5c90f3566f08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.406492 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b07c80dd111484081c24b87a8476e92', 'request_id': 'req-3c0558a8-ac93-43af-9a14-5c90f3566f08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.420960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] The token cache is being invalidate because project 0b07c80dd111484081c24b87a8476e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:54.421275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.421921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.423735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1240/2471] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:54 2022] DELETE /identity/v3/projects/0b07c80dd111484081c24b87a8476e92 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:54.428314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:54.438254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968347ef-3535-43f9-af86-a3a46a48a0c7 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:54.552033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:54.553220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:54.553598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:54.554016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] PATH_INFO: `/v3/users/9f289b9712614e5d8f4cf1c04f6aadad` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:54.555428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f289b9712614e5d8f4cf1c04f6aadad)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:54.558158 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:54.639243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f289b9712614e5d8f4cf1c04f6aadad'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.641762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f289b9712614e5d8f4cf1c04f6aadad'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.644968 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f289b9712614e5d8f4cf1c04f6aadad'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.685844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f289b9712614e5d8f4cf1c04f6aadad'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.700967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b4478668-217b-4bd0-a320-200430401f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f289b9712614e5d8f4cf1c04f6aadad'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:54.719896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1232/2472] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:02:54 2022] DELETE /identity/v3/users/9f289b9712614e5d8f4cf1c04f6aadad => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:55.105897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.109101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:55.139526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0558a8-ac93-43af-9a14-5c90f3566f08 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.223910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.227294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.228015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.228672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] PATH_INFO: `/v3/projects/d6c0bbbede46452fad1619ab85d8ee95` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.231119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c0bbbede46452fad1619ab85d8ee95)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.239135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.341207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c0bbbede46452fad1619ab85d8ee95', 'request_id': 'req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:55.356803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c0bbbede46452fad1619ab85d8ee95', 'request_id': 'req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:55.363657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c0bbbede46452fad1619ab85d8ee95', 'request_id': 'req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:55.397586 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] The token cache is being invalidate because project d6c0bbbede46452fad1619ab85d8ee95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:02:55.397905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:55.399712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1dc32747-8f4d-4c0d-a970-5aba1d6f5431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:02:55.405159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1241/2473] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:02:55 2022] DELETE /identity/v3/projects/d6c0bbbede46452fad1619ab85d8ee95 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:55.406957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.407246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.407524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.450875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:55.452539 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:55.525839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1233/2474] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:55.531100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.531830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.532133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.551896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:55.553185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:55.561266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1242/2475] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:02:55.567157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.577628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb789-2404-45e7-8f2e-e12ffd156cb6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.583316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.583977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.584258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.584555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.585278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:02:55.585582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.587220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.600495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1234/2476] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:02:55.604693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.615366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215932fa-4353-439f-a7fb-a279eba251ed None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.620260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.620917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.621193 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.621459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.622182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.624155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.652713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1243/2477] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:55 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:55.656866 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.667024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463d7d-1fbd-456d-b08c-c40e244ce843 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.740626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.741309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.741760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.742038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.742736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.744643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.775301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1235/2478] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:55 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:55.776542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.793414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372b58-5b73-424d-9319-78fa40010fbf admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.801440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.802160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.802441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.802830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.803566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.805222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.822805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1244/2479] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:55.823989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.835578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1643-ca5c-41de-b120-62ec2936339c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.840657 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.841320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.841600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.841927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.842646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.844220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c22df-4f00-49a9-85bb-c55171fc52ce admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.859750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1236/2480] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:55.861087 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:55.871531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe70fe-0de3-4f76-a20b-133dee43eec3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:55.876131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:55.877009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.877286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.878108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] PATH_INFO: `/v3/projects/27140ae6b79841cea2ee556c30bc6ced/users/86924bac9e644eb98deca077d52011a1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.898670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27140ae6b79841cea2ee556c30bc6ced, user_id=86924bac9e644eb98deca077d52011a1, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:55.906131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:55.937396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1245/2481] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:55 2022] PUT /identity/v3/projects/27140ae6b79841cea2ee556c30bc6ced/users/86924bac9e644eb98deca077d52011a1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:02:55.946067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:55.946281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:55.946567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:55.977533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:55.979702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:56.046183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:56.048190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:56.113102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1237/2482] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:56.123427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:56.129528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78607-9b57-4988-a951-f33a049327c0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:56.137354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:56.138046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:56.138333 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:56.138849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:56.140169 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb3b17-527e-49ce-8cdc-631a458cd0a4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:56.143322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:56.150073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:56.150961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:56.151318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:56.151661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:56.158652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:56.161384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7ae0-86a3-4c89-8dbe-fae2b9a11d55 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:56.173797 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1246/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:02:56.175616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:56.177067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:56.192229 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1238/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:02:57.599739 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:57.600291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:57.600384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:57.667798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] MFA Rules not processed for user `86924bac9e644eb98deca077d52011a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:57.670053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:57.834263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1247/2485] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:02:57.847860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:57.867901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac798f-c40b-4133-9070-ac90aa7dc85e service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:57.894417 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:57.895462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:57.900809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:57.901319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:57.902266 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:57.904389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:57.978488 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1239/2486] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:02:57 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:57.982273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:58.011768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b3ea-b0d9-41f1-9784-8810a5da9161 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:58.127243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:58.128710 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:58.129076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:58.129364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:58.131030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:58.134245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:58.180272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1248/2487] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:02:57 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:02:58.184318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:58.211662 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6c3c-0a6f-4dee-8334-a48378014dfe admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:58.216715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:58.217592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:58.218076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:58.218684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:58.219571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:58.222917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:58.243964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1240/2488] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:02:58.248091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:58.261451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ae108-249c-428d-afe3-8d962235ba83 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:58.276870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:58.277915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:58.278432 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:58.278876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] PATH_INFO: `/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8/users/2d26e1ab97d74a99b2bf0241aadcdbf2/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:58.310653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1746b6e89e64b04be755ca2a3b27aa8, user_id=2d26e1ab97d74a99b2bf0241aadcdbf2, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:58.313384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:58.337523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1249/2489] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:58 2022] PUT /identity/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8/users/2d26e1ab97d74a99b2bf0241aadcdbf2/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:02:58.341180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:58.354442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d974-46c2-450b-8d97-6097cd66d360 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:58.467836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:58.468512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:58.468794 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:58.469065 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:58.469827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:58.472001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5460e8-848c-4664-9794-0cdce255299c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:58.483053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1241/2490] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:02:58.487341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:02:58.499069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce9c51-0f23-4ec3-a37f-16f9aac5b0d8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:02:58.505424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:02:58.507059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:58.507800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:58.509199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] PATH_INFO: `/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8/users/2d26e1ab97d74a99b2bf0241aadcdbf2/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:58.512665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1746b6e89e64b04be755ca2a3b27aa8, user_id=2d26e1ab97d74a99b2bf0241aadcdbf2, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:02:58.516474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:02:58.530267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1250/2491] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:02:58 2022] PUT /identity/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8/users/2d26e1ab97d74a99b2bf0241aadcdbf2/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:02:59.467187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:02:59.467765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:02:59.467765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:02:59.496996 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] MFA Rules not processed for user `2d26e1ab97d74a99b2bf0241aadcdbf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:02:59.498243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:02:59.582892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1242/2492] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:00.991001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:00.992830 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:01.066314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1671d-5edc-4778-b25c-787cb9de418d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.071028 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.071848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.072748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.073030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] PATH_INFO: `/v3/users/ed75e7f09b1d4b60b45f7b024de32683` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.074263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed75e7f09b1d4b60b45f7b024de32683)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.076159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.128022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed75e7f09b1d4b60b45f7b024de32683'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.130016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed75e7f09b1d4b60b45f7b024de32683'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.130628 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed75e7f09b1d4b60b45f7b024de32683'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.143734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed75e7f09b1d4b60b45f7b024de32683'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.152075 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed75e7f09b1d4b60b45f7b024de32683'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.165756 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1251/2493] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:00 2022] DELETE /identity/v3/users/ed75e7f09b1d4b60b45f7b024de32683 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:01.541265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:01.553808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf4356-108a-4acc-b682-b2225362e086 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.566715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:01.568395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:01.617350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.618263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.618542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.618809 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] PATH_INFO: `/v3/users/86924bac9e644eb98deca077d52011a1` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.620000 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] RBAC: Authorizing `identity:delete_user(user_id=86924bac9e644eb98deca077d52011a1)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.621922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.642871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc40bb-8ed0-48d2-a16e-21d0e3fdeb81 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.649356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.650371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.650765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.651042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] PATH_INFO: `/v3/projects/4b1e03b7662e4cdaba4a6781dc483a86` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.652239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1e03b7662e4cdaba4a6781dc483a86)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.654510 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.668507 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86924bac9e644eb98deca077d52011a1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.669528 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86924bac9e644eb98deca077d52011a1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.669702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86924bac9e644eb98deca077d52011a1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.684485 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86924bac9e644eb98deca077d52011a1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.691964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-0d87ff18-caed-4b69-a672-930b742a896e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86924bac9e644eb98deca077d52011a1'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.704581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1243/2494] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:01 2022] DELETE /identity/v3/users/86924bac9e644eb98deca077d52011a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:01.706439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1e03b7662e4cdaba4a6781dc483a86', 'request_id': 'req-7c85976f-87f9-41b0-accf-daad5ca9005a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.713782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1e03b7662e4cdaba4a6781dc483a86', 'request_id': 'req-7c85976f-87f9-41b0-accf-daad5ca9005a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.720100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1e03b7662e4cdaba4a6781dc483a86', 'request_id': 'req-7c85976f-87f9-41b0-accf-daad5ca9005a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.735930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] The token cache is being invalidate because project 4b1e03b7662e4cdaba4a6781dc483a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:01.736210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.736850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7c85976f-87f9-41b0-accf-daad5ca9005a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:01.742555 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1252/2495] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:01 2022] DELETE /identity/v3/projects/4b1e03b7662e4cdaba4a6781dc483a86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:01.744325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.744620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.744901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.769433 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:01.770905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:01.847313 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1244/2496] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:01.849181 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.849472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.849801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.874884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:01.876194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:01.889284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1253/2497] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:01.890706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:01.901019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b89d-daaa-4118-b4ff-ef33f581ea3e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.905706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.906363 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.906645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.906927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.907678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:01.907961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.910051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.921969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1245/2498] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:03:01.927127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:01.937208 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:01.938647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6311-a2df-4356-a987-ba06f6368454 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.940316 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:01.945450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.946889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.947466 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.947935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.948822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.951584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.959091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7a51-a45e-4c53-9122-7c2c51729664 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:01.965263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:01.966159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:01.966442 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:01.966714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] PATH_INFO: `/v3/projects/27140ae6b79841cea2ee556c30bc6ced` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:01.967911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27140ae6b79841cea2ee556c30bc6ced)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:01.969964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:01.986025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1254/2499] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:01 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:01.988117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.032471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27140ae6b79841cea2ee556c30bc6ced', 'request_id': 'req-c99fe49b-779b-4869-8011-c64a8dc836a4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.038357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27140ae6b79841cea2ee556c30bc6ced', 'request_id': 'req-c99fe49b-779b-4869-8011-c64a8dc836a4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.045035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27140ae6b79841cea2ee556c30bc6ced', 'request_id': 'req-c99fe49b-779b-4869-8011-c64a8dc836a4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.054517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac854e5-bccd-4e36-84d6-54a969e95ed3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.057396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] The token cache is being invalidate because project 27140ae6b79841cea2ee556c30bc6ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:02.057728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.058371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.059903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1246/2500] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:01 2022] DELETE /identity/v3/projects/27140ae6b79841cea2ee556c30bc6ced => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:02.064153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.066076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.112102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.112851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.113152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.113423 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.114128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.116034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.130258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe49b-779b-4869-8011-c64a8dc836a4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.135078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.135939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.136200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1255/2501] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:01 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:02.136303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.136483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] PATH_INFO: `/v3/users/2d26e1ab97d74a99b2bf0241aadcdbf2` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.137691 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d26e1ab97d74a99b2bf0241aadcdbf2)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.139620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.140259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.141805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.154042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faf758-2d09-4044-97c9-3502479a466f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.158801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.159454 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.159735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.160010 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.160729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.162374 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.173191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1256/2502] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:03:02.177013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.186250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d26e1ab97d74a99b2bf0241aadcdbf2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.186652 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d62d-2e27-4aa8-a89d-7e1466cc377d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.191060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d26e1ab97d74a99b2bf0241aadcdbf2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.191864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d26e1ab97d74a99b2bf0241aadcdbf2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.192122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.192768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.193050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.193325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.194095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.195677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.203887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d26e1ab97d74a99b2bf0241aadcdbf2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.209702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1257/2503] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:02.210986 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.211491 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e9208008-3500-4a1c-8e66-7b87e6046d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d26e1ab97d74a99b2bf0241aadcdbf2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.212593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.224889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1247/2504] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:02 2022] DELETE /identity/v3/users/2d26e1ab97d74a99b2bf0241aadcdbf2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:02.225050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524ba0-9bb4-4991-b9db-97c6fd820cdb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.281589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.282530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.282813 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.283089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] PATH_INFO: `/v3/projects/277dc9a3662e4462ad715024341bb7b0/users/929581cfe4db49e0be9ec6c29b5354f1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.297171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277dc9a3662e4462ad715024341bb7b0, user_id=929581cfe4db49e0be9ec6c29b5354f1, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.300405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.315152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1258/2505] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:02 2022] PUT /identity/v3/projects/277dc9a3662e4462ad715024341bb7b0/users/929581cfe4db49e0be9ec6c29b5354f1/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:02.325058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.325404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.325713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.354577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] MFA Rules not processed for user `929581cfe4db49e0be9ec6c29b5354f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:02.355835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.428578 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.430898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.453135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1248/2506] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:02.465128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.467150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.519921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944f28-bebd-44d9-ae53-c50a189e50c3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.524865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.525759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.526043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.526320 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] PATH_INFO: `/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.527500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1746b6e89e64b04be755ca2a3b27aa8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.529393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.536454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208bf1-3b85-4f44-99f6-678d91487830 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.540222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.540868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.541145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.541418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.551086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.552560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28604c-66ec-439a-bbea-dd2e6d01d01b service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.562157 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1249/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:03:02.578295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1746b6e89e64b04be755ca2a3b27aa8', 'request_id': 'req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.583656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1746b6e89e64b04be755ca2a3b27aa8', 'request_id': 'req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.589833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1746b6e89e64b04be755ca2a3b27aa8', 'request_id': 'req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.602942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] The token cache is being invalidate because project a1746b6e89e64b04be755ca2a3b27aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:02.603258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.603893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7f9c6bbe-f680-469f-bb31-7c7443fe4f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:02.605896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1259/2508] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:02 2022] DELETE /identity/v3/projects/a1746b6e89e64b04be755ca2a3b27aa8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:02.610650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.610927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.611199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.630014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:02.631194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.689624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1250/2509] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:02.697951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.698282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.698500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.718276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:02.719463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:02.728206 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1260/2510] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:02.732623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.742632 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f54e1-a8c7-4c53-b66c-d6f5b399f411 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.747328 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.748638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.749163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.749711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.751120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:02.751696 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.754861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.768109 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1251/2511] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:03:02.772865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.782860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8938f3-58cd-4fe9-9cc0-9470badc97f8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.789561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.790355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.790635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.790908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.791588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.793518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.821367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1261/2512] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:02 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:02.825381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.836825 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ed67-9fa5-46d1-9160-46c7988ea2ed admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.901326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.902037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.902319 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.902779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.903468 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.905368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.929332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1252/2513] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:02 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:02.932405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.943235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c6d9-12aa-4e3e-8dbb-cd1083f57f85 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.948783 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.949447 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.949763 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.950040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.950765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.952355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:02.964262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1262/2514] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:02.968146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:02.979243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d936-c05e-44db-8471-cdf7b81cc772 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:02.984044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:02.984700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:02.984995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:02.985259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:02.986020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:02.987663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b32186-a9bf-4c1e-bf2f-72d7af4168d2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.000028 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1253/2515] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:03.004235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.014157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c100128-d421-4cb7-bc6d-6342748b5267 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.019319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.020196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.020478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.020874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] PATH_INFO: `/v3/projects/8b135a08949646c89b5f08c8dc786432/users/a6d0e400c12d400cb8c8e98107f80ec9/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.035804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b135a08949646c89b5f08c8dc786432, user_id=a6d0e400c12d400cb8c8e98107f80ec9, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.038503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.051418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1263/2516] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:03 2022] PUT /identity/v3/projects/8b135a08949646c89b5f08c8dc786432/users/a6d0e400c12d400cb8c8e98107f80ec9/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:03.061565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.061891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.062172 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.088317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] MFA Rules not processed for user `a6d0e400c12d400cb8c8e98107f80ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:03.089498 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:03.151784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1254/2517] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:03.156215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.220142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df2979-8363-4dc2-b252-c87c52338f15 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.226091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.226744 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.227019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.227446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.228946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.231060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.258316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1264/2518] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:03 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:03.262811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.275839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa7dd5-fc76-47fe-8369-924286eced51 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.330357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.331771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.332081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.332325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.333335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.335282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.356173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1255/2519] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:03 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:03.360104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.370253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a33e-17af-4232-8ec4-2eec92b5cb79 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.374749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.375391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.375665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.375939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.376647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.379141 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.389416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1265/2520] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:03.394520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.404448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae39c-1aba-4c17-838e-ec22418969c6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.409055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.409956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.410289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.410569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] PATH_INFO: `/v3/projects/03d42d31342c405abbf2e86debafe77f/users/9c0b564d4b6e41c4a03cdc48ea17d43b/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.425090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d42d31342c405abbf2e86debafe77f, user_id=9c0b564d4b6e41c4a03cdc48ea17d43b, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.427782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.441269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1256/2521] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:03 2022] PUT /identity/v3/projects/03d42d31342c405abbf2e86debafe77f/users/9c0b564d4b6e41c4a03cdc48ea17d43b/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:03.445352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.455179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f380c92-ce5c-4db5-9820-6f7d65ba8dd6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.510298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.510974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.511252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.511522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.512245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.513844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d47f1-9fec-4dc7-8e11-c3218f30bcec admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.524878 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1266/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:03.529002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.539062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249461-4955-4b7c-882e-bce4ae3817cd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.543709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.544579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.544859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.545133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] PATH_INFO: `/v3/projects/03d42d31342c405abbf2e86debafe77f/users/9c0b564d4b6e41c4a03cdc48ea17d43b/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.547120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d42d31342c405abbf2e86debafe77f, user_id=9c0b564d4b6e41c4a03cdc48ea17d43b, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.549852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.560727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1257/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:03 2022] PUT /identity/v3/projects/03d42d31342c405abbf2e86debafe77f/users/9c0b564d4b6e41c4a03cdc48ea17d43b/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:03.573595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.573943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.574227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.601440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] MFA Rules not processed for user `9c0b564d4b6e41c4a03cdc48ea17d43b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:03.602692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:03.679598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1267/2524] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:03.692002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.693745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:03.750773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727842f4-5e90-475c-ba34-2c3d983ff8d3 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.755071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.755742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.756016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.756254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.765812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.767230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2675-11a4-4b3d-9eb4-59b03967ea13 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.777733 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1258/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:03.854450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:03.864843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ce6f-9aaa-46b5-8e53-76fb3c08fab7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:03.868772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:03.869537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:03.869966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:03.870528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:03.936160 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:03.937712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b389e-a6cf-49ce-ba8f-4dd426a8df6e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:03.948225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1268/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:05.148061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:05.149465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:05.149961 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] PATH_INFO: `/` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:05.152353 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1259/2527] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 5 15:03:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:03:05.159146 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511d4d-7c86-436d-a62f-5b878e723965 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:05.159675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511d4d-7c86-436d-a62f-5b878e723965 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:05.160175 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511d4d-7c86-436d-a62f-5b878e723965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:05.189793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3a511d4d-7c86-436d-a62f-5b878e723965 None None] MFA Rules not processed for user `b2f119b3cd5647b39942bdc91f95d8df`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:05.189793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3a511d4d-7c86-436d-a62f-5b878e723965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:05.259472 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1269/2528] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 5 15:03:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:05.272550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:05.275454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:05.347368 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d20b-3106-416d-98a3-95793eb82e42 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:05.351554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:05.352240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:05.352746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:05.352985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:05.375210 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:05.376688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:05.391148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1260/2529] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:09.893574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:09.894670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:09.894670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:09.914105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:09.915274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:09.978883 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1270/2530] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 5 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:09.991380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:09.992789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:10.069207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e79401-b1c4-48e6-a92d-801faf4a6fbb service glance] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:10.074844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:10.075492 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:10.075775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:10.076053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:10.085497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:10.089982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102425-d07a-467c-ac4b-28f495ae31e0 service swift] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:10.100434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1261/2531] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:03:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:03:13.283891 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:13.285478 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:13.353004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6e611-f950-48f6-9d36-d5af41c50b02 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:13.357557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:13.358452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:13.358731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:13.359003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] PATH_INFO: `/v3/users/929581cfe4db49e0be9ec6c29b5354f1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:13.360244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929581cfe4db49e0be9ec6c29b5354f1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:13.362728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:13.436801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929581cfe4db49e0be9ec6c29b5354f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:13.437357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929581cfe4db49e0be9ec6c29b5354f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:13.437977 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929581cfe4db49e0be9ec6c29b5354f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:13.460874 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929581cfe4db49e0be9ec6c29b5354f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:13.468748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929581cfe4db49e0be9ec6c29b5354f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:13.482899 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1271/2532] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:13 2022] DELETE /identity/v3/users/929581cfe4db49e0be9ec6c29b5354f1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:13.488444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:13.488976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:13.491237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:13.519502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:13.521568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:13.612026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1262/2533] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:13.622672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:13.624077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:13.716238 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecf20-1819-44e9-b38e-1680000c8e46 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:13.719942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:13.721274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:13.722130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:13.722130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:13.745918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:13.747528 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2076-eb87-4550-9c0e-eaddb045c5f0 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:13.773825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1272/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:03:14.110735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.112682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:14.138884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0716b2-fd9c-4c82-9a45-2c6ad99fa7a6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.156944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.158184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.158872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.159256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] PATH_INFO: `/v3/projects/277dc9a3662e4462ad715024341bb7b0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.160801 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277dc9a3662e4462ad715024341bb7b0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.163182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.214626 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277dc9a3662e4462ad715024341bb7b0', 'request_id': 'req-c4b46ed2-d8e7-454d-b426-f6a469709cf6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:14.220146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277dc9a3662e4462ad715024341bb7b0', 'request_id': 'req-c4b46ed2-d8e7-454d-b426-f6a469709cf6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:14.226646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277dc9a3662e4462ad715024341bb7b0', 'request_id': 'req-c4b46ed2-d8e7-454d-b426-f6a469709cf6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:14.241067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] The token cache is being invalidate because project 277dc9a3662e4462ad715024341bb7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:14.241355 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:14.242153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c4b46ed2-d8e7-454d-b426-f6a469709cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:14.243998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1263/2535] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:14 2022] DELETE /identity/v3/projects/277dc9a3662e4462ad715024341bb7b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:14.249201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.249831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.250176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.276337 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:14.277595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:14.345625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1273/2536] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:14.353860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.354152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.354435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.374418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:14.375623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:14.384708 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1264/2537] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:14.389065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.403355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e87a35-6de5-4cec-a7a4-be7fc98fe09a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.418562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.419589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.419955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.420651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.421522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:14.421941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.424589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.442006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1274/2538] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:03:14.446287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.456387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35871efd-e351-4b00-888c-74443c66bc03 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.461171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.461858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.462138 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.462407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.463100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.464989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.499333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1265/2539] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:14 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:14.505927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.515837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8a786-e8af-49c5-9361-9b8b7f3df8ac admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.582312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.583029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.583310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.583593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.584289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.586292 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.622592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1275/2540] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:14 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:14.625471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.637769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9d2c4-6a79-4ebd-a75f-b023b33aca92 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.642495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.642495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.642751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.642910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.643979 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.645610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.668428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1266/2541] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:03:14.670500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.694132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559012c3-f1c6-40cb-af9e-63a264b5b516 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.705630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.706630 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.707084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.707529 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.708425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.710496 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054359-04bd-4484-8fa8-f5e4293e2260 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.726908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1276/2542] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:03:14.730807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:14.746463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cb668-5817-45d4-801c-ed84f8d8976b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:14.752312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:14.755931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.756220 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.756501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] PATH_INFO: `/v3/projects/56675f8d37834c7cb41f6f50d81d6889/users/a12d8d974ff343ef95aed68650c5e973/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.777659 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56675f8d37834c7cb41f6f50d81d6889, user_id=a12d8d974ff343ef95aed68650c5e973, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:14.780331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:14.803552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1267/2543] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:14 2022] PUT /identity/v3/projects/56675f8d37834c7cb41f6f50d81d6889/users/a12d8d974ff343ef95aed68650c5e973/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:14.813533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:14.814122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:14.814443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:14.877749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] MFA Rules not processed for user `a12d8d974ff343ef95aed68650c5e973`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:14.879675 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:15.040401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1277/2544] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:15.041788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.144616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f415b-7809-4616-80df-3bbe8b5af728 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.150756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.151669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.152748 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.153036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.153811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.155669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.192111 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1268/2545] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:15 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:15.196030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.217001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa80a-0582-4625-985f-2c0001e65fbf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.288188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.288857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.289268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.289547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.290406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.292600 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.323066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1278/2546] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:15 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:15.331140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.345051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204cccb-d75d-43b1-8eed-d2a55396a7bc admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.350764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.351614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.351957 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.352176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.352909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.354834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.370153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1269/2547] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:15.374537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.385910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dbee-109e-49a5-bc67-799d72825c27 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.390782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.391791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.392099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.392481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] PATH_INFO: `/v3/projects/5c9bd4d3937b4758911155d6138f11d9/users/4f71867c354746c9be12072eca7a4f35/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.411548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9bd4d3937b4758911155d6138f11d9, user_id=4f71867c354746c9be12072eca7a4f35, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.414923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.431669 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1279/2548] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:15 2022] PUT /identity/v3/projects/5c9bd4d3937b4758911155d6138f11d9/users/4f71867c354746c9be12072eca7a4f35/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:15.435873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.447244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9f44-21b6-4c77-b95a-0f23376d4ab2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.528470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.529207 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.529416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.529731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.530467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.535070 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c36f-b5b8-4ef5-a7f0-2b65aa1cace7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.546246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1270/2549] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:15.550822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.561086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81ef0-dd62-420d-9840-c4193dc2829c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.566846 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.567727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.568001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.568272 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] PATH_INFO: `/v3/projects/5c9bd4d3937b4758911155d6138f11d9/users/4f71867c354746c9be12072eca7a4f35/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.570263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9bd4d3937b4758911155d6138f11d9, user_id=4f71867c354746c9be12072eca7a4f35, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.572886 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.589713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1280/2550] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:15 2022] PUT /identity/v3/projects/5c9bd4d3937b4758911155d6138f11d9/users/4f71867c354746c9be12072eca7a4f35/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:15.601045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.601334 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.601617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.631137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] MFA Rules not processed for user `4f71867c354746c9be12072eca7a4f35`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:15.632400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:15.710195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1271/2551] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:15.721718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:15.723465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:15.800282 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaedbe8-5f4b-4d17-9868-d6333d40b39f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:15.804536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:15.805281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:15.805558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:15.805865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:15.868655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:15.870135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854562-901d-4c9d-b7fd-36e0c6c588ef service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:15.880987 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1281/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:21.625699 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:21.627736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:21.639536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6494528-fb92-4e7c-ac46-6b96fff554a1 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:21.643660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:21.644314 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:21.644608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:21.644865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:21.654096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:21.655506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:21.665290 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1272/2553] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:30.923867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:30.923867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:30.924762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:30.942831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:30.943943 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:30.997131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1282/2554] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:31.019490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:31.020880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:31.089159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873c77d-9593-449b-987b-78be4a4554f1 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:31.094268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:31.095445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:31.095728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:31.096140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:31.104254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:31.105879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:31.114984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1273/2555] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:03:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:03:37.754248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:37.755668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:37.821135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28208be-01d7-494e-8c77-ea614e5e5cd2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:37.824900 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:37.825768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:37.826450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:37.826728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:37.828819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:37.908963 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:37.911441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23c37-c67d-4c5b-997c-686712531e3f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:37.921039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1283/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:53.615627 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:53.678282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622ea3-d44e-4d48-ae89-28afb112a3f5 service swift] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:53.682802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:53.683656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:53.683999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:53.684279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] PATH_INFO: `/v3/users/a12d8d974ff343ef95aed68650c5e973` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:53.685458 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12d8d974ff343ef95aed68650c5e973)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:53.687429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:53.732315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12d8d974ff343ef95aed68650c5e973'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:53.732949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12d8d974ff343ef95aed68650c5e973'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:53.733536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12d8d974ff343ef95aed68650c5e973'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:53.746127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12d8d974ff343ef95aed68650c5e973'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:53.753904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12d8d974ff343ef95aed68650c5e973'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:53.766563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1274/2557] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:53 2022] DELETE /identity/v3/users/a12d8d974ff343ef95aed68650c5e973 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:53.771150 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:53.771657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:53.771754 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:53.790382 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:53.791549 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:53.848561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1284/2558] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:53.858182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:53.859569 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:53.915785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26885-cbad-4f38-bce8-5ce97fef6ed8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:53.919436 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:53.920071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:53.920354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:53.920651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:53.930946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:53.932366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:53.942073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1275/2559] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:03:54.204415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:54.205947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:54.218576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de79c8-0008-4a8c-b63d-dddb572009fd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:54.224772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:54.225638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:54.226008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:54.226286 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] PATH_INFO: `/v3/projects/56675f8d37834c7cb41f6f50d81d6889` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:54.228691 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56675f8d37834c7cb41f6f50d81d6889)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:54.230506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:54.278316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56675f8d37834c7cb41f6f50d81d6889', 'request_id': 'req-3df47211-1e32-42b3-9216-ac06e80cbec0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.284182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56675f8d37834c7cb41f6f50d81d6889', 'request_id': 'req-3df47211-1e32-42b3-9216-ac06e80cbec0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.290433 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56675f8d37834c7cb41f6f50d81d6889', 'request_id': 'req-3df47211-1e32-42b3-9216-ac06e80cbec0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.303880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] The token cache is being invalidate because project 56675f8d37834c7cb41f6f50d81d6889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:54.304166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.304794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.306366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1285/2560] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:54 2022] DELETE /identity/v3/projects/56675f8d37834c7cb41f6f50d81d6889 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:54.310321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:54.321200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d077-0d48-4f27-932a-48ade07bf5b4 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:54.385236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:54.386149 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:54.386504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:54.386800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] PATH_INFO: `/v3/users/4f71867c354746c9be12072eca7a4f35` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:54.388076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f71867c354746c9be12072eca7a4f35)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:54.390673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:54.454896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f71867c354746c9be12072eca7a4f35'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.455562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f71867c354746c9be12072eca7a4f35'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.456281 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f71867c354746c9be12072eca7a4f35'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.469543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f71867c354746c9be12072eca7a4f35'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.478444 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f71867c354746c9be12072eca7a4f35'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.492143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1276/2561] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:54 2022] DELETE /identity/v3/users/4f71867c354746c9be12072eca7a4f35 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:54.767190 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:54.768658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:54.782409 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df47211-1e32-42b3-9216-ac06e80cbec0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:54.816906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:54.818268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:54.854850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:54.855738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:54.856029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:54.856316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] PATH_INFO: `/v3/users/a6d0e400c12d400cb8c8e98107f80ec9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:54.857500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d0e400c12d400cb8c8e98107f80ec9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:54.859538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:54.904688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359213a7-a905-4c74-9af3-6ccedd651ecc admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:54.913636 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d0e400c12d400cb8c8e98107f80ec9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.913870 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:54.914311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d0e400c12d400cb8c8e98107f80ec9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.914747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:54.914926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d0e400c12d400cb8c8e98107f80ec9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.915053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:54.915269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] PATH_INFO: `/v3/projects/5c9bd4d3937b4758911155d6138f11d9` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:54.916462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9bd4d3937b4758911155d6138f11d9)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:54.919470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:54.928601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d0e400c12d400cb8c8e98107f80ec9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.936999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f702412d-814a-4386-ac22-e4ea2aa0e63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d0e400c12d400cb8c8e98107f80ec9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.950785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1286/2562] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:54 2022] DELETE /identity/v3/users/a6d0e400c12d400cb8c8e98107f80ec9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:54.955917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:54.957065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:54.957349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:54.973543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9bd4d3937b4758911155d6138f11d9', 'request_id': 'req-e27cfd19-6f67-4b95-9156-8a29677aaf01'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.979469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9bd4d3937b4758911155d6138f11d9', 'request_id': 'req-e27cfd19-6f67-4b95-9156-8a29677aaf01'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.979745 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:54.980969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:54.986463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9bd4d3937b4758911155d6138f11d9', 'request_id': 'req-e27cfd19-6f67-4b95-9156-8a29677aaf01'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:54.999735 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] The token cache is being invalidate because project 5c9bd4d3937b4758911155d6138f11d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:55.000003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.002038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e27cfd19-6f67-4b95-9156-8a29677aaf01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.004110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1277/2563] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:54 2022] DELETE /identity/v3/projects/5c9bd4d3937b4758911155d6138f11d9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:55.008924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a632-244b-4e91-9cb8-4a0efc1dfcde None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.009212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a632-244b-4e91-9cb8-4a0efc1dfcde None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.009494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a632-244b-4e91-9cb8-4a0efc1dfcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.033915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4d59a632-244b-4e91-9cb8-4a0efc1dfcde None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:55.035137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4d59a632-244b-4e91-9cb8-4a0efc1dfcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.050808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1287/2564] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:55.057403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.058829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.099416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1278/2565] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:55.107912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.108423 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.108824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.128123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:55.129765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.132270 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b418-b60d-4610-a3c7-a12f5ea842de None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.136184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.136831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.137115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.137393 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.138097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1279/2566] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:55.142960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.147860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.149319 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.151817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63868c3-33b6-4169-b1d3-4a796b69d7f4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.156502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.157162 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.157439 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.157747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.158472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:55.158781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.159018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1288/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:03:55.160365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.175560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1280/2568] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:03:55.177597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.187061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c427b2e-0657-49a3-af17-40d92d71d405 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.192848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.193615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.193848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.194235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.194940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.196834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.224029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1289/2569] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:55.228297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.239054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad266f-8e34-4f3a-a74b-a7024c5d4dea admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.296972 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.298038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.298326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.298604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.299292 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.301212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.323298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1281/2570] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:55.327391 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.339130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8eb3-915f-47df-9ca9-3308243197ac admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.343946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.344616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.344897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.345199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.345950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.347533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.358227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1290/2571] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:55.362288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.372531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b5b77-d6db-4a19-b370-d8d5ee138961 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.378047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.378643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.378924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.379199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.379926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.381946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.393038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1282/2572] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:55.397137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.407465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d8951-6e74-412d-a506-77b1e2f78215 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.415034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.416000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.416298 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.417095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] PATH_INFO: `/v3/projects/51fa484f6db84dd1b3dd1703b154202b/users/31ce9a492e0d45d4b9dd085b9a51ddd4/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.434893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fa484f6db84dd1b3dd1703b154202b, user_id=31ce9a492e0d45d4b9dd085b9a51ddd4, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.438633 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1e701-6fe1-4064-9a6d-1b2aacf719fb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.449773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.451556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.460343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1291/2573] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:55 2022] PUT /identity/v3/projects/51fa484f6db84dd1b3dd1703b154202b/users/31ce9a492e0d45d4b9dd085b9a51ddd4/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:55.474124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12007570-fdd2-4105-bb70-6a2efcd5ba75 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.479172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.479694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.480194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.511667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] MFA Rules not processed for user `31ce9a492e0d45d4b9dd085b9a51ddd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:55.512904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.543104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.544235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.544513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.544788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] PATH_INFO: `/v3/projects/8b135a08949646c89b5f08c8dc786432` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.546119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b135a08949646c89b5f08c8dc786432)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.549008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.585543 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1292/2574] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:55.590629 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.599347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b135a08949646c89b5f08c8dc786432', 'request_id': 'req-efd86359-88cd-43b6-8906-6b8ed6a173e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.602822 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7dab6-4904-4cf4-b8a8-183060d5f289 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.605269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b135a08949646c89b5f08c8dc786432', 'request_id': 'req-efd86359-88cd-43b6-8906-6b8ed6a173e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.613150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b135a08949646c89b5f08c8dc786432', 'request_id': 'req-efd86359-88cd-43b6-8906-6b8ed6a173e7'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.627655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] The token cache is being invalidate because project 8b135a08949646c89b5f08c8dc786432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:55.627990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.628644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.630665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1283/2575] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:55 2022] DELETE /identity/v3/projects/8b135a08949646c89b5f08c8dc786432 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:55.634678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.635779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.664573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.665154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.665417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.665714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.666401 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.668327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.696195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1293/2576] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:55.699659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.701280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.704360 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86359-88cd-43b6-8906-6b8ed6a173e7 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.766599 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.767495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.767765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.768040 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] PATH_INFO: `/v3/users/9c0b564d4b6e41c4a03cdc48ea17d43b` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.769291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0b564d4b6e41c4a03cdc48ea17d43b)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.771259 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.773740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e712-a33f-4ac2-a1b6-ee447c7764be admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.778724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.779396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.779681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.779967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.780651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.782727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.805274 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1294/2577] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:55 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:55.809290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.820811 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60c67-64ad-4ba8-bbf6-65672e6bed62 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.822711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0b564d4b6e41c4a03cdc48ea17d43b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.823724 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0b564d4b6e41c4a03cdc48ea17d43b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.824299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0b564d4b6e41c4a03cdc48ea17d43b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.826867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.827533 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.827818 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.828095 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.829115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.832182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.837658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0b564d4b6e41c4a03cdc48ea17d43b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.842098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1295/2578] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:03:55.846102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0b564d4b6e41c4a03cdc48ea17d43b'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:55.847344 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.849030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:55.859393 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1284/2579] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:55 2022] DELETE /identity/v3/users/9c0b564d4b6e41c4a03cdc48ea17d43b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:55.867644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b89a-97a6-4fee-8662-07dc0074559f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:55.924050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:55.924887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:55.925167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:55.925443 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] PATH_INFO: `/v3/projects/507292525a2d401589a0d31e7dc40c1a/users/2c603be6f8e24d82b3afc9f276835336/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:55.940895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507292525a2d401589a0d31e7dc40c1a, user_id=2c603be6f8e24d82b3afc9f276835336, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:55.943598 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:55.957304 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1296/2580] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:55 2022] PUT /identity/v3/projects/507292525a2d401589a0d31e7dc40c1a/users/2c603be6f8e24d82b3afc9f276835336/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:55.961461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:55.972184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aaba7-a5ab-4144-8bf4-0213eff3255e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.035579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.036280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.036622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.036903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.037625 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.039247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15333a7c-da45-495a-ba7d-e0783b08acd6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.049556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1285/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:03:56.054094 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.064725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9e95-bf6a-43d7-8de0-d77d3a68bfb4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.069534 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.070442 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.070853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.071137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] PATH_INFO: `/v3/projects/507292525a2d401589a0d31e7dc40c1a/users/2c603be6f8e24d82b3afc9f276835336/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.073294 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507292525a2d401589a0d31e7dc40c1a, user_id=2c603be6f8e24d82b3afc9f276835336, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.075940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.086758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1297/2582] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:56 2022] PUT /identity/v3/projects/507292525a2d401589a0d31e7dc40c1a/users/2c603be6f8e24d82b3afc9f276835336/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:56.099008 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.099298 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.099579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.128563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] MFA Rules not processed for user `2c603be6f8e24d82b3afc9f276835336`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:56.129982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.206148 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1286/2583] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:56.218171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.220931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.280823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc947c-6ca3-4934-aa4d-544cc6fb6157 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.286061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.286713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.286996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.287623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.299668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.301373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.313403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1298/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:56.320728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.323124 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.345995 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.414744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127574f6-afa6-4dd4-a297-4d7d59ba1a97 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.424705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.430973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.431430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.431840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] PATH_INFO: `/v3/projects/03d42d31342c405abbf2e86debafe77f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.433541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d42d31342c405abbf2e86debafe77f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.435880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.437245 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc49a2-35ad-44c0-84c5-ab3716e9e115 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.445080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.446785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.447068 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.447347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] PATH_INFO: `/v3/users/31ce9a492e0d45d4b9dd085b9a51ddd4` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.448958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ce9a492e0d45d4b9dd085b9a51ddd4)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.452290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.516121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d42d31342c405abbf2e86debafe77f', 'request_id': 'req-c138acb1-51cd-445a-a152-5f38764e82af'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.522759 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d42d31342c405abbf2e86debafe77f', 'request_id': 'req-c138acb1-51cd-445a-a152-5f38764e82af'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.523709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ce9a492e0d45d4b9dd085b9a51ddd4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.524897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ce9a492e0d45d4b9dd085b9a51ddd4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.526038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ce9a492e0d45d4b9dd085b9a51ddd4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.533105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d42d31342c405abbf2e86debafe77f', 'request_id': 'req-c138acb1-51cd-445a-a152-5f38764e82af'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.540560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ce9a492e0d45d4b9dd085b9a51ddd4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.552034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7bb679c-3895-4f3b-a49e-1c1c18aac90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ce9a492e0d45d4b9dd085b9a51ddd4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.558456 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] The token cache is being invalidate because project 03d42d31342c405abbf2e86debafe77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:56.558876 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.560083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c138acb1-51cd-445a-a152-5f38764e82af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:56.564079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1287/2585] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:56 2022] DELETE /identity/v3/projects/03d42d31342c405abbf2e86debafe77f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:56.571840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.572187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1299/2586] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:56 2022] DELETE /identity/v3/users/31ce9a492e0d45d4b9dd085b9a51ddd4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:56.572593 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.573101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.577623 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27711bf-e902-41cf-88be-aa6c21def90c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.578367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27711bf-e902-41cf-88be-aa6c21def90c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.578795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27711bf-e902-41cf-88be-aa6c21def90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.597960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:56.600170 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.613170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c27711bf-e902-41cf-88be-aa6c21def90c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:56.615224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c27711bf-e902-41cf-88be-aa6c21def90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.713204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1300/2587] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:56.721001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1288/2588] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:56.723058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.724022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.725183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.726023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.726547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.753023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:56.754742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:56.772800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1301/2589] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:56.777515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.787619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8762e9b-35d4-41e0-a35d-c961bbf29110 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.793154 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.793939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.794696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.795017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.795748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:56.796670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.798497 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.809331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5ce0-6346-4805-9e35-5597638493cd None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.811949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1302/2590] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:03:56.815312 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.816159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.816542 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.816764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.817377 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.827515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638e2e-425e-419d-b842-a4d5d3c32cb4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.830143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.832961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.833108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.833740 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.834092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.834525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.835380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.837357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.850650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1289/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:56.872944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1303/2592] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:56.878552 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:56.889264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6fa7b-0a2f-4b76-bbcf-7c7f10a1c653 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:56.958108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:56.958982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:56.959357 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:56.959726 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:56.960532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:56.962645 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:56.987901 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1290/2593] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:56 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:56.991826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.004467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc43f2-948d-430a-86f7-c4c8ea7b3cb1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.010226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.012201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.012641 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.012920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.013741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.015465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.028952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1304/2594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:57.033703 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.044766 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae935-a92d-470d-b97c-4ff55d60d719 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.050306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.050713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.051072 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.051418 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.052223 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.054361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a2786-87cf-456c-8eb0-fe3073c7cbb3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.066505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1291/2595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:57.070471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.081727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe0174-1e7b-4870-b0cb-f94edc88ba62 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.087269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.088402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.088775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.089113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] PATH_INFO: `/v3/projects/9edb0f856e2c43e1b743e737605ad8b0/users/da8963618efd45ffac227a923344f932/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.108002 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edb0f856e2c43e1b743e737605ad8b0, user_id=da8963618efd45ffac227a923344f932, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.111428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.127601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1305/2596] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:57 2022] PUT /identity/v3/projects/9edb0f856e2c43e1b743e737605ad8b0/users/da8963618efd45ffac227a923344f932/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:57.138176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.138948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.139375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.176352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] MFA Rules not processed for user `da8963618efd45ffac227a923344f932`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:57.177526 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.255711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1292/2597] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:57.255946 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.323865 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e208c-1c5e-4cf5-bd5c-87ddd9e49a4b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.329958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.330658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.330932 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.331199 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.331907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.333851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.364367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1306/2598] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:57 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:57.368174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.382607 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36f2a-d47b-49a5-8841-b1f56f6aa97f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.400379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.402224 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.458269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.459047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.459394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.459897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.460669 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.462707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.483892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690989-dd3f-4893-9298-ed80455a192c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.488450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1293/2599] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:57 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:57.489592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.490013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.491117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.491587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.491930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] PATH_INFO: `/v3/projects/51fa484f6db84dd1b3dd1703b154202b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.493189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fa484f6db84dd1b3dd1703b154202b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.495547 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.501325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975894-ebce-402b-bea9-a1b564fe56ba admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.510315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.511036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.511390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.511903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.512982 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.516674 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.527051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1294/2600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:57.531515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.543912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615646f-4a99-4e7a-b1ab-ed75e5a4c7cd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.554552 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fa484f6db84dd1b3dd1703b154202b', 'request_id': 'req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.564280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fa484f6db84dd1b3dd1703b154202b', 'request_id': 'req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.570967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fa484f6db84dd1b3dd1703b154202b', 'request_id': 'req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.587397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] The token cache is being invalidate because project 51fa484f6db84dd1b3dd1703b154202b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:57.587760 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.588945 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.593685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1307/2601] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:57 2022] DELETE /identity/v3/projects/51fa484f6db84dd1b3dd1703b154202b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:57.595100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.596526 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.613864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.615152 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.615536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.616037 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] PATH_INFO: `/v3/projects/ac88b60fc4db4d06b63b20951022f209/users/7153dcdb09bb4dd19092caf59a3d3099/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.635747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac88b60fc4db4d06b63b20951022f209, user_id=7153dcdb09bb4dd19092caf59a3d3099, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.638459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.652679 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1295/2602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:57 2022] PUT /identity/v3/projects/ac88b60fc4db4d06b63b20951022f209/users/7153dcdb09bb4dd19092caf59a3d3099/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:57.656518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.658258 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.670666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2bed-ce03-45b8-9102-8a5ebc5ed7fe admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.727263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59913-a34e-406d-a16c-06c276f5ce5c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.728762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.729653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.729955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.730227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] PATH_INFO: `/v3/users/2c603be6f8e24d82b3afc9f276835336` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.731399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c603be6f8e24d82b3afc9f276835336)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.731878 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.732532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.732812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.733088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.733293 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.733865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.736139 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.745797 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1296/2603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:57.749944 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.760950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181487ec-ebd2-4a7e-958d-40726ef8e247 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.766428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.767339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.767621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.767896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] PATH_INFO: `/v3/projects/ac88b60fc4db4d06b63b20951022f209/users/7153dcdb09bb4dd19092caf59a3d3099/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.770175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac88b60fc4db4d06b63b20951022f209, user_id=7153dcdb09bb4dd19092caf59a3d3099, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.772785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e237-a38d-4901-94ff-5991af4a47ac admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:57.780281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c603be6f8e24d82b3afc9f276835336'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.780931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c603be6f8e24d82b3afc9f276835336'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.781672 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c603be6f8e24d82b3afc9f276835336'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.782783 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1297/2604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:57 2022] PUT /identity/v3/projects/ac88b60fc4db4d06b63b20951022f209/users/7153dcdb09bb4dd19092caf59a3d3099/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:03:57.792918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c603be6f8e24d82b3afc9f276835336'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.793378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.793378 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.793615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.800544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c603be6f8e24d82b3afc9f276835336'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:57.814459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1308/2605] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:03:57 2022] DELETE /identity/v3/users/2c603be6f8e24d82b3afc9f276835336 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:57.823474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] MFA Rules not processed for user `7153dcdb09bb4dd19092caf59a3d3099`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:57.824594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.895561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1298/2606] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:03:57.906960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:57.908973 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:57.974683 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eff12-f0bb-42a9-9364-fdc9207be135 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:57.978976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:57.980179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:57.980179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:57.980749 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:57.991524 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:57.992609 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.003707 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1309/2607] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:58.077651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.090637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f123d-42cd-47ff-ad2e-1e9971f36bc5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.095601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7351482-9069-4517-840f-356971388953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.096369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351482-9069-4517-840f-356971388953 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.097060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351482-9069-4517-840f-356971388953 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.097060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351482-9069-4517-840f-356971388953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.099318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-b7351482-9069-4517-840f-356971388953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:58.182668 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7351482-9069-4517-840f-356971388953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.184101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7351482-9069-4517-840f-356971388953 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.194277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1299/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:58.267488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.268959 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:58.344842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe17a-914b-4e74-a8fe-d6639548f799 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.349340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.350260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.350535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.350800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] PATH_INFO: `/v3/projects/507292525a2d401589a0d31e7dc40c1a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.351982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507292525a2d401589a0d31e7dc40c1a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.353918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.402226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507292525a2d401589a0d31e7dc40c1a', 'request_id': 'req-de346337-1ac2-4354-93c7-d2388a5e52b2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:58.407897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507292525a2d401589a0d31e7dc40c1a', 'request_id': 'req-de346337-1ac2-4354-93c7-d2388a5e52b2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:58.414077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507292525a2d401589a0d31e7dc40c1a', 'request_id': 'req-de346337-1ac2-4354-93c7-d2388a5e52b2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:58.429949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] The token cache is being invalidate because project 507292525a2d401589a0d31e7dc40c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:03:58.429949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:58.432301 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de346337-1ac2-4354-93c7-d2388a5e52b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:03:58.433856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1310/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:03:58 2022] DELETE /identity/v3/projects/507292525a2d401589a0d31e7dc40c1a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:58.439822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.440114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.440394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.458101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:58.459289 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:58.527711 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1300/2610] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:58.529419 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.529753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.530018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.549051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:58.550290 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:58.561698 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1311/2611] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:58.565745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.575765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1d7cb-8c12-4e50-85e0-1867225edfcb None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.582510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.583181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.583448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.583718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.584448 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:03:58.584754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.586462 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.599653 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1301/2612] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:03:58.603939 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.614098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c2ece-a4a7-4c7e-9359-df2db5a9841a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.619504 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.620260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.620638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.621062 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.621876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.623839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.653931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1312/2613] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:58.655347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.665354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d6b00-593e-4aeb-a350-e18b50e36bd8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.721594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.722293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.722575 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.722859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.724020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.725451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.749473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1302/2614] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:58.751346 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.761459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd49514-4621-47ce-9588-6cea7bc3fe23 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.766235 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.766895 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.767177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.767451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.768171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.769810 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.782969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1313/2615] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:58.784020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.793747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbabb03-996a-49d8-b76e-f324eafbeb09 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.799128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.799778 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.800060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.800331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.801047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.802660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4631a2-e280-4eba-bee2-eccef2a96523 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.812541 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1303/2616] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:58.817734 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:58.828674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600301-2cad-4475-a0ee-2a073f689ba5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:58.833823 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:58.834713 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.834998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.835276 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] PATH_INFO: `/v3/projects/64828a10b69a4430b3513f231cf66ea5/users/cf1b9c7952a448989881e1e483f9c57b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.851602 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64828a10b69a4430b3513f231cf66ea5, user_id=cf1b9c7952a448989881e1e483f9c57b, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:58.854295 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:58.868491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1314/2617] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:58 2022] PUT /identity/v3/projects/64828a10b69a4430b3513f231cf66ea5/users/cf1b9c7952a448989881e1e483f9c57b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:58.879046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:58.879337 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:58.879622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:58.906977 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] MFA Rules not processed for user `cf1b9c7952a448989881e1e483f9c57b`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:58.908714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:58.991567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1304/2618] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:58.994022 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.060982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f22e8-a1de-4789-92ff-7e9de3a23263 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.067101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.067759 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.068039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.068312 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.068996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.070902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.099018 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1315/2619] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:03:58 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:03:59.100255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.116380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349c08f-c888-492d-87c7-c88004afc37f None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.179616 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.180332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.180563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.180838 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.181519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.183446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.204510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1305/2620] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:03:59 2022] POST /identity/v3/users => generated 310 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:03:59.208705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.219486 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02983-f42c-42f6-8f08-5f8d1cea8dbc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.224376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.224735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.225013 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.225287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.226038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.227640 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.239265 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1316/2621] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:59.245003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.255990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fff5d-3ee9-4f9e-95cc-f73b56575e0f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.260932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.261859 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.262141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.262428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] PATH_INFO: `/v3/projects/99382173f3d3447d8507b669fb2f31bc/users/61e41a2ec10f4207a6a53b521e6f631a/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.278497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99382173f3d3447d8507b669fb2f31bc, user_id=61e41a2ec10f4207a6a53b521e6f631a, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.281143 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.295565 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1306/2622] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:59 2022] PUT /identity/v3/projects/99382173f3d3447d8507b669fb2f31bc/users/61e41a2ec10f4207a6a53b521e6f631a/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:59.301451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.320269 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c721-8c0a-4bcf-b788-e7e71acd62fa admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.414130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.414800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.415257 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.415414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.416040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.417791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352483e8-87b9-47da-b628-9b0c00f4630a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.439152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1317/2623] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:03:59.445193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.462719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f78b-d6ea-4361-8f47-f11677c0a49c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.475834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.477989 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.479004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.480495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] PATH_INFO: `/v3/projects/99382173f3d3447d8507b669fb2f31bc/users/61e41a2ec10f4207a6a53b521e6f631a/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.483573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99382173f3d3447d8507b669fb2f31bc, user_id=61e41a2ec10f4207a6a53b521e6f631a, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.489984 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.513246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1307/2624] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:03:59 2022] PUT /identity/v3/projects/99382173f3d3447d8507b669fb2f31bc/users/61e41a2ec10f4207a6a53b521e6f631a/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:03:59.524300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.524584 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.524857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.553712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] MFA Rules not processed for user `61e41a2ec10f4207a6a53b521e6f631a`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:03:59.554839 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:59.637589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1318/2625] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:03:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:03:59.648461 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.650198 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:59.725631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e306-ee6f-45d5-b310-957a51d062d0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.729600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.730276 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.730556 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.730830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.745827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.747608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:03:59.758692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1308/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:03:59.914747 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:03:59.916897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:03:59.932196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76469c00-7aeb-4805-a507-fe50cfa020a7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:03:59.935905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:03:59.936581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:03:59.936860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:03:59.937134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:03:59.995410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:03:59.996862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:00.005837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1319/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:07.240643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:07.242943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:07.315822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b364a0-bf14-4f00-a739-02c2f2655fce service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:07.320397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:07.321257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:07.321534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:07.321826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] PATH_INFO: `/v3/users/396c93aa74a74f37b8a5377eeaca99e2` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:07.323003 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] RBAC: Authorizing `identity:delete_user(user_id=396c93aa74a74f37b8a5377eeaca99e2)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:07.324956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:07.379948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396c93aa74a74f37b8a5377eeaca99e2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.380592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396c93aa74a74f37b8a5377eeaca99e2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.381185 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396c93aa74a74f37b8a5377eeaca99e2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.392964 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396c93aa74a74f37b8a5377eeaca99e2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.400606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396c93aa74a74f37b8a5377eeaca99e2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.413738 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1309/2628] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:07 2022] DELETE /identity/v3/users/396c93aa74a74f37b8a5377eeaca99e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:07.588605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:07.617741 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ee9a-ecbb-479f-a12e-3d7224ebdba1 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:07.673941 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:07.674826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:07.675107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:07.675381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] PATH_INFO: `/v3/projects/00847662f3c54b2a81e47a0bcd5c3a08` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:07.676567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00847662f3c54b2a81e47a0bcd5c3a08)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:07.678508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:07.730130 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00847662f3c54b2a81e47a0bcd5c3a08', 'request_id': 'req-54539e9d-2c61-4915-a0cc-96edffec95cd'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.736742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00847662f3c54b2a81e47a0bcd5c3a08', 'request_id': 'req-54539e9d-2c61-4915-a0cc-96edffec95cd'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.744177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00847662f3c54b2a81e47a0bcd5c3a08', 'request_id': 'req-54539e9d-2c61-4915-a0cc-96edffec95cd'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.758473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] The token cache is being invalidate because project 00847662f3c54b2a81e47a0bcd5c3a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:07.758857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.759666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.761474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1320/2629] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:07 2022] DELETE /identity/v3/projects/00847662f3c54b2a81e47a0bcd5c3a08 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:07.765888 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:07.767249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:07.780557 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34f1c-22bb-4534-9384-b2e27b67036a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:07.846430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:07.847085 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:07.847367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:07.847688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] PATH_INFO: `/v3/users/0e411eb7857b40f0877a154174810571` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:07.848844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e411eb7857b40f0877a154174810571)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:07.850796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:07.913342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e411eb7857b40f0877a154174810571'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.913623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e411eb7857b40f0877a154174810571'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.914426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e411eb7857b40f0877a154174810571'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.927624 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e411eb7857b40f0877a154174810571'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.935986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e411eb7857b40f0877a154174810571'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:07.951373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1310/2630] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:07 2022] DELETE /identity/v3/users/0e411eb7857b40f0877a154174810571 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:07.961546 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:07.963058 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:08.026626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539e9d-2c61-4915-a0cc-96edffec95cd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:08.077508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:08.079361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:08.079639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:08.079913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:08.081751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:08.152118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:08.153664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:08.163897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1321/2631] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:08.341530 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:08.343166 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:08.373175 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c530855-627f-4f2f-9217-86c15879bf9b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:08.379247 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:08.380288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:08.380576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:08.380855 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] PATH_INFO: `/v3/projects/a35a525a5f3e4cd0a3d153391f764452` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:08.382164 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35a525a5f3e4cd0a3d153391f764452)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:08.384824 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:08.439747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35a525a5f3e4cd0a3d153391f764452', 'request_id': 'req-443a9c57-7297-4c8e-887c-fa5c9a3526fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:08.445061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35a525a5f3e4cd0a3d153391f764452', 'request_id': 'req-443a9c57-7297-4c8e-887c-fa5c9a3526fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:08.451147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35a525a5f3e4cd0a3d153391f764452', 'request_id': 'req-443a9c57-7297-4c8e-887c-fa5c9a3526fb'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:08.464949 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] The token cache is being invalidate because project a35a525a5f3e4cd0a3d153391f764452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:08.465359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:08.466039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-443a9c57-7297-4c8e-887c-fa5c9a3526fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:08.467584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1311/2632] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:08 2022] DELETE /identity/v3/projects/a35a525a5f3e4cd0a3d153391f764452 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:09.142365 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:09.143922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:09.155516 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cdc65-b54f-4f71-8bd3-b9cf9c89257c service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:09.214507 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:09.215383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:09.215664 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:09.215940 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] PATH_INFO: `/v3/users/da8963618efd45ffac227a923344f932` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:09.217123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8963618efd45ffac227a923344f932)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:09.219354 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:09.268205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8963618efd45ffac227a923344f932'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.268844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8963618efd45ffac227a923344f932'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.269427 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8963618efd45ffac227a923344f932'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.280266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8963618efd45ffac227a923344f932'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.287935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8963618efd45ffac227a923344f932'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.300313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1322/2633] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:09 2022] DELETE /identity/v3/users/da8963618efd45ffac227a923344f932 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:09.305089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:09.305407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:09.305705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:09.323566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:09.324757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:09.381122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1312/2634] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:09.390825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:09.392264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:09.455350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc604-157a-4d2d-b0e5-120f8ed055c2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:09.459051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:09.459764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:09.460219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:09.460488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:09.470766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:09.472187 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:09.482589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1323/2635] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:09.761613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:09.763180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:09.782631 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78afdd-1f3e-44ed-887d-dbe4d8cbeb5b None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:09.787948 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:09.790272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:09.790913 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:09.791644 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] PATH_INFO: `/v3/projects/9edb0f856e2c43e1b743e737605ad8b0` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:09.793486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edb0f856e2c43e1b743e737605ad8b0)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:09.795620 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:09.845815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edb0f856e2c43e1b743e737605ad8b0', 'request_id': 'req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.851297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edb0f856e2c43e1b743e737605ad8b0', 'request_id': 'req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.857617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edb0f856e2c43e1b743e737605ad8b0', 'request_id': 'req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.870713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] The token cache is being invalidate because project 9edb0f856e2c43e1b743e737605ad8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:09.870986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.871623 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.873365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1313/2636] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:09 2022] DELETE /identity/v3/projects/9edb0f856e2c43e1b743e737605ad8b0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:09.877693 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:09.887367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c078-34c1-4477-b91b-ee646b16a74c service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:09.946834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:09.947711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:09.947998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:09.948273 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] PATH_INFO: `/v3/users/7153dcdb09bb4dd19092caf59a3d3099` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:09.949484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7153dcdb09bb4dd19092caf59a3d3099)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:09.951450 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:09.996723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7153dcdb09bb4dd19092caf59a3d3099'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.997369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7153dcdb09bb4dd19092caf59a3d3099'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:09.997991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7153dcdb09bb4dd19092caf59a3d3099'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.009405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7153dcdb09bb4dd19092caf59a3d3099'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.017573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7153dcdb09bb4dd19092caf59a3d3099'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.029518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1324/2637] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:09 2022] DELETE /identity/v3/users/7153dcdb09bb4dd19092caf59a3d3099 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:10.289303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.290765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.305765 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18ca9d-5982-4e8e-a690-f7df7b2d9306 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.367095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.367946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.368226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.368495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] PATH_INFO: `/v3/projects/ac88b60fc4db4d06b63b20951022f209` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.369677 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac88b60fc4db4d06b63b20951022f209)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.371897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.419584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac88b60fc4db4d06b63b20951022f209', 'request_id': 'req-1531064d-44df-4be3-83f6-fb6336db137a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.426513 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac88b60fc4db4d06b63b20951022f209', 'request_id': 'req-1531064d-44df-4be3-83f6-fb6336db137a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.432805 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.433275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac88b60fc4db4d06b63b20951022f209', 'request_id': 'req-1531064d-44df-4be3-83f6-fb6336db137a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.434455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.446045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] The token cache is being invalidate because project ac88b60fc4db4d06b63b20951022f209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:10.446330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.446976 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-1531064d-44df-4be3-83f6-fb6336db137a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.448485 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8802-2f18-46a8-bd98-bac290e2a4b7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.449710 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1314/2638] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:10 2022] DELETE /identity/v3/projects/ac88b60fc4db4d06b63b20951022f209 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:10.453877 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95f8d-199b-4c09-a851-05e17074a652 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.454159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95f8d-199b-4c09-a851-05e17074a652 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.454434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95f8d-199b-4c09-a851-05e17074a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.472399 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-72a95f8d-199b-4c09-a851-05e17074a652 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:10.474046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-72a95f8d-199b-4c09-a851-05e17074a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.505671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.506560 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.506844 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.507120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] PATH_INFO: `/v3/users/cf1b9c7952a448989881e1e483f9c57b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.508325 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1b9c7952a448989881e1e483f9c57b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.510369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.531840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1315/2639] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:10.540098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.540454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.540808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.559800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:10.559998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1b9c7952a448989881e1e483f9c57b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.560642 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1b9c7952a448989881e1e483f9c57b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.560975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.561241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1b9c7952a448989881e1e483f9c57b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.570262 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1316/2640] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:10.573887 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1b9c7952a448989881e1e483f9c57b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.574296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.581307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40edcb02-16da-437a-950c-8a604abdcf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1b9c7952a448989881e1e483f9c57b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:10.583796 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909fec2-55f7-41f3-8151-3b1c21d97668 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.588311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.588943 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.589222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.589493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.590240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:10.590542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.592110 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.593587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1325/2641] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:10 2022] DELETE /identity/v3/users/cf1b9c7952a448989881e1e483f9c57b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:10.598051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.598342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.598621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.611099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1317/2642] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:04:10.612034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.616934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:10.618148 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.621478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7365e-d20c-4a8f-8cf8-dea344373e22 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.674982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1326/2643] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:10.675447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.676106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.676389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.676663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.677335 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.679279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.684506 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.685968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:10.706311 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1318/2644] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:10.710117 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.742766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268d33-3458-44af-ac24-2e5bd25dfbe5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.771083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89167096-1315-4686-a7bb-8923c2d24abd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.775578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.776242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.776527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.776807 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.777487 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.779424 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.789123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.789794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.790078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.790343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.800766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.801941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1319/2645] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:10.805173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.805931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.815651 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1327/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:04:10.816408 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a310d-d2fa-440b-bda5-a31ce9ab9da6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.821062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.821806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.822092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.822369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.823147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.824727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.836237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1320/2647] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:10.840315 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.850958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4997a0-cccf-47a4-96be-e0c930c99889 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.855782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.856438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.856723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.856998 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.857869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.860303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff31a34-6ecd-4385-b7d7-8a700cf136b0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.870877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1328/2648] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:10.875469 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:10.886421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ddc3-bf12-4439-ae97-df75dc1e0ce0 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:10.891832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:10.892782 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.893059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.893330 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] PATH_INFO: `/v3/projects/e172398f9f7d4da7be5cb484b1500a15/users/b6309666f8d64df79b9363c7b6d5949e/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.909253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172398f9f7d4da7be5cb484b1500a15, user_id=b6309666f8d64df79b9363c7b6d5949e, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:10.912401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:10.926272 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1321/2649] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:10 2022] PUT /identity/v3/projects/e172398f9f7d4da7be5cb484b1500a15/users/b6309666f8d64df79b9363c7b6d5949e/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:10.936635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:10.936929 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:10.937281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:10.972706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] MFA Rules not processed for user `b6309666f8d64df79b9363c7b6d5949e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:10.973954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.040785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1329/2650] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:11.045332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.111773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7953d0-b34a-42b3-85a1-b3448ca71750 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.118973 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.119630 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.119907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.120176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.120898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.122806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.145404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.147530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.158293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1322/2651] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:11.162238 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.163613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e87718-f88e-4596-965e-1750782c2d80 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.236177 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.237070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.237350 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.237622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] PATH_INFO: `/v3/projects/64828a10b69a4430b3513f231cf66ea5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.237822 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64942c2-41f0-4aac-af1f-b017e537f8ce admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.238834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64828a10b69a4430b3513f231cf66ea5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.240728 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.242271 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.242924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.243204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.243470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.244141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.246094 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.266505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1323/2652] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:11.270723 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.280067 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b1c3-9b4a-471e-9169-69d6f454f27c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.286452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64828a10b69a4430b3513f231cf66ea5', 'request_id': 'req-abd66cbb-9778-4f44-9bbe-649c0b6327a3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.291873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64828a10b69a4430b3513f231cf66ea5', 'request_id': 'req-abd66cbb-9778-4f44-9bbe-649c0b6327a3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.300341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64828a10b69a4430b3513f231cf66ea5', 'request_id': 'req-abd66cbb-9778-4f44-9bbe-649c0b6327a3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.315383 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] The token cache is being invalidate because project 64828a10b69a4430b3513f231cf66ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:11.315621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.316195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.318123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1330/2653] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:11 2022] DELETE /identity/v3/projects/64828a10b69a4430b3513f231cf66ea5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:11.321593 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.322920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.338872 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.339544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.339823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.340099 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.340817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.342472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.352081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1324/2654] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:11.356055 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.357784 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.370634 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eab55-5c37-4e27-a4c8-a9d8c63d26af admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.375892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.376647 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.376926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.377257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.377945 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.379506 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.385254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd66cbb-9778-4f44-9bbe-649c0b6327a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.389986 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1325/2655] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:11.390222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.391188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.391475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.391751 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] PATH_INFO: `/v3/users/61e41a2ec10f4207a6a53b521e6f631a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.393102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e41a2ec10f4207a6a53b521e6f631a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.393962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.394909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.403361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345401d-e9cf-410d-9d38-457e46597857 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.408178 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.409069 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.409352 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.409628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] PATH_INFO: `/v3/projects/b8924c595fef47b5aaa2519e45da1a92/users/e8fbeb0e704840ea88303086e97c2bfb/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.426460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8924c595fef47b5aaa2519e45da1a92, user_id=e8fbeb0e704840ea88303086e97c2bfb, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.429097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553a923-e7a2-4abb-9175-b01758d6ee19 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.445165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1326/2656] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:11 2022] PUT /identity/v3/projects/b8924c595fef47b5aaa2519e45da1a92/users/e8fbeb0e704840ea88303086e97c2bfb/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:11.448610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e41a2ec10f4207a6a53b521e6f631a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.449351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e41a2ec10f4207a6a53b521e6f631a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.449974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e41a2ec10f4207a6a53b521e6f631a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.456571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.456892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.457173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.461853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e41a2ec10f4207a6a53b521e6f631a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.469853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e41a2ec10f4207a6a53b521e6f631a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.482267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1331/2657] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:11 2022] DELETE /identity/v3/users/61e41a2ec10f4207a6a53b521e6f631a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:11.486257 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] MFA Rules not processed for user `e8fbeb0e704840ea88303086e97c2bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:11.487454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.553549 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1327/2658] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:11.558219 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.560048 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.629851 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ede7c2-30b5-4502-9ae9-ce7eacdb20ab admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.635373 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.636042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.636345 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.636612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.637311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.639243 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.667363 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1332/2659] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:11.668756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.680443 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7fda-ce39-461b-b3f5-e5469254c1a4 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.739063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.739752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.740035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.740305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.741066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.743163 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.751481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.753439 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.763382 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1328/2660] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:11.767232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.773666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90b6c-70cb-4207-813d-6122265356a7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.776956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae958d-6769-4bf5-872e-addf9b2dcb26 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.778603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.779462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.779812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.779999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] PATH_INFO: `/v3/projects/99382173f3d3447d8507b669fb2f31bc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.782287 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99382173f3d3447d8507b669fb2f31bc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.782413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.783063 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.783346 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.783619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.784104 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.784332 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.785932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.795978 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1329/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:11.800736 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.810280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdde01f-ce57-419a-ab69-8411a9801907 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.815516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.816380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.816665 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.816941 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] PATH_INFO: `/v3/projects/d53958de050345a3ab5df291cc77d417/users/4d282d24471045a9b16c5646f17b877c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.831451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99382173f3d3447d8507b669fb2f31bc', 'request_id': 'req-77fc552e-9508-4cc5-9de0-9ddf89621263'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.832384 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53958de050345a3ab5df291cc77d417, user_id=4d282d24471045a9b16c5646f17b877c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.835046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.837123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99382173f3d3447d8507b669fb2f31bc', 'request_id': 'req-77fc552e-9508-4cc5-9de0-9ddf89621263'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.844817 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99382173f3d3447d8507b669fb2f31bc', 'request_id': 'req-77fc552e-9508-4cc5-9de0-9ddf89621263'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.848747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1330/2662] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:11 2022] PUT /identity/v3/projects/d53958de050345a3ab5df291cc77d417/users/4d282d24471045a9b16c5646f17b877c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:11.854154 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.857903 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] The token cache is being invalidate because project 99382173f3d3447d8507b669fb2f31bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:11.858247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.858890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-77fc552e-9508-4cc5-9de0-9ddf89621263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:11.860988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1333/2663] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:11 2022] DELETE /identity/v3/projects/99382173f3d3447d8507b669fb2f31bc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:11.865582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c81dc-e453-4ca6-8356-02a2a363061f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.865896 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c81dc-e453-4ca6-8356-02a2a363061f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.866173 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c81dc-e453-4ca6-8356-02a2a363061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.883594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-662c81dc-e453-4ca6-8356-02a2a363061f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:11.884775 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-662c81dc-e453-4ca6-8356-02a2a363061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.914867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff537-cef6-43af-83b1-45067e108d6b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.919581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.920242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.920524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.920802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.922128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.923903 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.934032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1331/2664] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:11.938042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:11.939953 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.944937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1334/2665] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:11.952404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.953434 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb62581-8612-426a-953a-d3ba6409ddc8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:11.953738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.953738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.957749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:11.958615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.958898 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.959202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] PATH_INFO: `/v3/projects/d53958de050345a3ab5df291cc77d417/users/4d282d24471045a9b16c5646f17b877c/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:11.961181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53958de050345a3ab5df291cc77d417, user_id=4d282d24471045a9b16c5646f17b877c, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:11.963817 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014e6da-6887-48f9-abd0-26daef3deac6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:11.972101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:11.973278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:11.974603 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1332/2666] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:11 2022] PUT /identity/v3/projects/d53958de050345a3ab5df291cc77d417/users/4d282d24471045a9b16c5646f17b877c/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:11.984639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:11.984921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:11.985200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.010426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] MFA Rules not processed for user `4d282d24471045a9b16c5646f17b877c`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:12.011684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.033589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1335/2667] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:12.037500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.046500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c255f15-5796-430f-927d-5c90f8ff523b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.051186 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.051834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.052119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.052392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.053113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:12.053420 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.055046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.066924 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1336/2668] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:04:12.071121 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.082053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163df3b-a69b-4b0e-bb4c-3810d8e93cc7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.085762 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1333/2669] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:12.087284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.087919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.088196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.088911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.089129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.091026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.094121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.095536 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.121793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1337/2670] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:12.122769 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.153020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28583f5d-09d2-49db-9aef-a53b7da186d6 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.183368 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25433-4f32-406d-bbf0-ed7f822e7346 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.189037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.189738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.190024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.190331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.191165 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.193070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.200077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.200718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.201004 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.201273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.212674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1338/2671] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:12.216680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.227914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21938db-fbd3-4df7-96f1-c22f1f7f6a87 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.233370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.234517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.235001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.235284 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.236017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.237743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.248501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1339/2672] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:12.252406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.262220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c1f5a-8776-402a-b751-605597414099 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.267053 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.267468 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.268228 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.268515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.268709 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.269102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.269956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.271614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb064cba-160d-4396-9e81-b9d3cb4b8b11 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.278366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1334/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:04:12.284313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1340/2674] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:12.288270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.299799 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05442dd4-780c-4f43-8895-59ef000f7848 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.304466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.305419 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.305741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.306017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] PATH_INFO: `/v3/projects/aae64c66d9754a91a620558f02e0e444/users/5bf0033c19724ffa8439ce83fcb70b0f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.323400 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae64c66d9754a91a620558f02e0e444, user_id=5bf0033c19724ffa8439ce83fcb70b0f, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.326098 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.341459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1335/2675] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:12 2022] PUT /identity/v3/projects/aae64c66d9754a91a620558f02e0e444/users/5bf0033c19724ffa8439ce83fcb70b0f/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:12.352515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.352806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.353091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.385679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] MFA Rules not processed for user `5bf0033c19724ffa8439ce83fcb70b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:12.386909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.463689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1341/2676] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:12.467995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.537362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885968d-7cc0-481d-aefb-d6df13fe9ed1 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.543061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.543790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.544095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.544411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.545131 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.547731 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.573658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1336/2677] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:12.578369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.589456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518f9eb-87c2-429f-b686-5f7534975566 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.648696 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.649366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.649668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.649942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.650615 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.652499 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.672907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1342/2678] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:12.680277 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.691483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfbd4d-dc5d-46fd-8b2e-f3d9ab246652 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.696181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.696833 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.697115 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.697387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.698141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.699713 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.710709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1337/2679] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:12.715220 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.725922 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab3db-bd2c-4ec6-9821-2b903e583dff admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.730656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.731643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.731795 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.732065 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] PATH_INFO: `/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1/users/c730a259425944fba7fcccf087926e79/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.748666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc1eeacc53c4ee699f870da5cdf47f1, user_id=c730a259425944fba7fcccf087926e79, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.751980 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.765161 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1343/2680] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:12 2022] PUT /identity/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1/users/c730a259425944fba7fcccf087926e79/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:12.769168 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.778800 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.779076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0865-e54f-4f3f-828b-7ab26fd7e65a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.780475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.835652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.836235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.836550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.836828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.837543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.839227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.839356 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e6c-6608-4142-9e62-fbde19b60471 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.844582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.845338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.845620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.845937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.847724 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.849816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1338/2681] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:12.853922 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:12.864471 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3082342-48f0-4fcf-a852-79ac6ead8ba1 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:12.869058 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:12.869963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.870242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.870567 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] PATH_INFO: `/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1/users/c730a259425944fba7fcccf087926e79/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.872522 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc1eeacc53c4ee699f870da5cdf47f1, user_id=c730a259425944fba7fcccf087926e79, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.875755 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb73e4c-4b61-4b51-a5e5-3ba28759491a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.885828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1339/2682] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:12 2022] PUT /identity/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1/users/c730a259425944fba7fcccf087926e79/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:12.897451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:12.897815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:12.898100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:12.905911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:12.907869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:12.916951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1344/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:04:12.926341 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] MFA Rules not processed for user `c730a259425944fba7fcccf087926e79`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:12.927532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:12.993477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1340/2684] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:13.005348 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:13.013658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a0bdd-20c6-491b-8602-cd15f77a68c8 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:13.065194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:13.065975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:13.066258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:13.066540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:13.076366 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:13.077849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a281f-392c-4255-bd34-f4d27474970d service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:13.087858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1345/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:13.463118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:13.525921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4241a13-4d8b-4ac1-9e29-c17d1b57bb3c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:13.530356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:13.531905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:13.532182 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:13.532678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] PATH_INFO: `/v3/users/5bf0033c19724ffa8439ce83fcb70b0f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:13.533893 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf0033c19724ffa8439ce83fcb70b0f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:13.535788 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:13.581416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf0033c19724ffa8439ce83fcb70b0f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:13.582077 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf0033c19724ffa8439ce83fcb70b0f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:13.582670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf0033c19724ffa8439ce83fcb70b0f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:13.594578 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf0033c19724ffa8439ce83fcb70b0f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:13.601802 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf0033c19724ffa8439ce83fcb70b0f'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:13.615519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1341/2686] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:13 2022] DELETE /identity/v3/users/5bf0033c19724ffa8439ce83fcb70b0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:13.620378 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:13.620892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:13.621005 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:13.638876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:13.640557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:13.700523 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1346/2687] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:13.711336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:13.712756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:13.768338 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b0d1b-6621-4f2f-9c96-53096715f7d2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:13.771931 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:13.772561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:13.772865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:13.773136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:13.782740 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:13.784159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:13.793294 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1342/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:14.049638 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.051114 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:14.063462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ca46-4ebb-4d5b-bf66-18f54208a9f7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:14.068334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:14.069260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.069613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.070004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] PATH_INFO: `/v3/projects/aae64c66d9754a91a620558f02e0e444` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.071326 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae64c66d9754a91a620558f02e0e444)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:14.073440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:14.119255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae64c66d9754a91a620558f02e0e444', 'request_id': 'req-dde9be5b-0dcf-4a81-9643-f57cbc07537c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.124246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae64c66d9754a91a620558f02e0e444', 'request_id': 'req-dde9be5b-0dcf-4a81-9643-f57cbc07537c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.130870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae64c66d9754a91a620558f02e0e444', 'request_id': 'req-dde9be5b-0dcf-4a81-9643-f57cbc07537c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.142842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] The token cache is being invalidate because project aae64c66d9754a91a620558f02e0e444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:14.143061 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.143667 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.145258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1347/2689] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:14 2022] DELETE /identity/v3/projects/aae64c66d9754a91a620558f02e0e444 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:14.149387 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.159118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56950-d18c-41e8-8747-3110fd064218 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:14.215455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:14.216340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.216614 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.216879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] PATH_INFO: `/v3/users/c730a259425944fba7fcccf087926e79` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.218082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c730a259425944fba7fcccf087926e79)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:14.220606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:14.266884 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c730a259425944fba7fcccf087926e79'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.267534 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c730a259425944fba7fcccf087926e79'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.268133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c730a259425944fba7fcccf087926e79'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.279466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c730a259425944fba7fcccf087926e79'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.287035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-e3f8c60c-2f2b-43c0-b7cf-3e3b1b55b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c730a259425944fba7fcccf087926e79'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.300396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1343/2690] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:14 2022] DELETE /identity/v3/users/c730a259425944fba7fcccf087926e79 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:14.571100 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.572525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:14.595538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9be5b-0dcf-4a81-9643-f57cbc07537c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:14.656975 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:14.657470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.657735 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.658012 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] PATH_INFO: `/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.659666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc1eeacc53c4ee699f870da5cdf47f1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:14.661559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:14.709086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc1eeacc53c4ee699f870da5cdf47f1', 'request_id': 'req-cadcbc0b-c126-430e-b995-85db42e0f5d4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.714263 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc1eeacc53c4ee699f870da5cdf47f1', 'request_id': 'req-cadcbc0b-c126-430e-b995-85db42e0f5d4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.721303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc1eeacc53c4ee699f870da5cdf47f1', 'request_id': 'req-cadcbc0b-c126-430e-b995-85db42e0f5d4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.733864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] The token cache is being invalidate because project 1dc1eeacc53c4ee699f870da5cdf47f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:14.734645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.735396 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-cadcbc0b-c126-430e-b995-85db42e0f5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:14.737120 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1348/2691] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:14 2022] DELETE /identity/v3/projects/1dc1eeacc53c4ee699f870da5cdf47f1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:14.741742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.742234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.742362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.759641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:14.760869 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:14.818729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1344/2692] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:14.826587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.826875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.827153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.845414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:14.846648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:14.854361 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1349/2693] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:14.858397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.868460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583a975-9e9e-469a-a40e-bd442b770e59 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:14.872963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:14.873601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.873907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.874176 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.874935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:14.875234 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:14.876790 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:14.887769 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1345/2694] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:04:14.892541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.901430 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd53c-f81d-4222-ba24-0a8018de98a4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:14.907085 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:14.907656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:14.907937 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:14.908210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:14.908892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:14.910785 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:14.938498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1350/2695] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:14 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:14.942727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:14.954700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80914f-f73f-4963-85e3-f0674a8dce33 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.008450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.009108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.009390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.009695 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.010380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.012302 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.032960 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1346/2696] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:14 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:15.037029 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.047157 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb795-d715-4df7-bf7c-1a0f7e0ab995 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.051701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.052349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.052626 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.052898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.053618 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.055222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.065482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1351/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:15.069222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.079604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5db8-8366-4205-ae04-aae2632b1704 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.084199 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.084852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.085137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.085415 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.086174 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.087752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf116-cba4-47e4-99c3-52a7c09e9cc5 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.098135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1347/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:15.102487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.112414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7c4e-06c9-40e6-a108-00eebafed2e2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.117024 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.117923 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.118203 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.118473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] PATH_INFO: `/v3/projects/1e6eadf0b3d146c6a40ba41d804eb9e1/users/a087e9f3cf2143e2a9d78d2dccda8d54/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.132458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6eadf0b3d146c6a40ba41d804eb9e1, user_id=a087e9f3cf2143e2a9d78d2dccda8d54, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.135223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.147491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1352/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:15 2022] PUT /identity/v3/projects/1e6eadf0b3d146c6a40ba41d804eb9e1/users/a087e9f3cf2143e2a9d78d2dccda8d54/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:15.159114 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.159343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.159652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.185005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] MFA Rules not processed for user `a087e9f3cf2143e2a9d78d2dccda8d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:15.186218 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:15.250466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1348/2700] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:15.255040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.314970 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221cadf-8099-4a1b-a045-951b1fec3eef admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.319718 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.320369 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.320648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.321027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.321755 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.323631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.348394 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1353/2701] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:15 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:15.352447 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.362917 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155744be-ee67-43ca-a289-f7769e9dbaf2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.416955 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.417615 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.417950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.418228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.418905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.421041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.448912 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1349/2702] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:15 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:15.450491 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.461417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28c0d-d6b0-428f-94fb-76423b6086d1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.466387 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.467047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.467329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.467605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.473217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.473217 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.480731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1354/2703] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:15.486104 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.496153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9042a-2bd3-4502-b38f-360cbd381b32 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.501715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.502589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.502873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.503150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] PATH_INFO: `/v3/projects/3023923106aa43c79d90be05eaf916bc/users/c88a229aaabe4b76ba3b1f1584c32048/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.519594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3023923106aa43c79d90be05eaf916bc, user_id=c88a229aaabe4b76ba3b1f1584c32048, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.522253 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.536092 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1350/2704] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:15 2022] PUT /identity/v3/projects/3023923106aa43c79d90be05eaf916bc/users/c88a229aaabe4b76ba3b1f1584c32048/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:15.540479 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.551635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73385d-b1ae-4dd2-8f29-5e49e23b692e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.610170 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.610836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.611115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.611444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.612158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.613767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb75a7-9ff0-4661-bdc3-263d6edca30c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.627978 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1355/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:15.629230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.643107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479de06-d6e1-49c0-a993-d29178074abb admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.648255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.649136 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.649416 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.649895 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] PATH_INFO: `/v3/projects/3023923106aa43c79d90be05eaf916bc/users/c88a229aaabe4b76ba3b1f1584c32048/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.651862 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3023923106aa43c79d90be05eaf916bc, user_id=c88a229aaabe4b76ba3b1f1584c32048, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.654494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.666326 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1351/2706] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:15 2022] PUT /identity/v3/projects/3023923106aa43c79d90be05eaf916bc/users/c88a229aaabe4b76ba3b1f1584c32048/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:15.680544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.681004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.681169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.709867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] MFA Rules not processed for user `c88a229aaabe4b76ba3b1f1584c32048`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:15.711086 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:15.778911 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1356/2707] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:15.790649 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.792339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:15.849119 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008b8e1-52db-4bac-9f36-cce71efb4a0d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.852839 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.853479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.853814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.854090 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:15.864005 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:15.865445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:15.875317 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1352/2708] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:15.946144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:15.955663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ba8e-ee95-4188-9d66-8fa4b12bfc1a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:15.959300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:15.959933 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:15.960208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:15.960476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:16.017408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:16.018877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd06b6-defe-4d2e-85b7-29e94a6105fd service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:16.027676 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1357/2709] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:16.280349 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:16.341102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452d74-8cc6-430f-a02d-4589ba69bcab service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:16.346057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:16.346908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:16.347189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:16.347465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] PATH_INFO: `/v3/users/a087e9f3cf2143e2a9d78d2dccda8d54` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:16.348651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a087e9f3cf2143e2a9d78d2dccda8d54)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:16.350574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:16.394678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a087e9f3cf2143e2a9d78d2dccda8d54'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.395325 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a087e9f3cf2143e2a9d78d2dccda8d54'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.395927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a087e9f3cf2143e2a9d78d2dccda8d54'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.407573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a087e9f3cf2143e2a9d78d2dccda8d54'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.414435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a087e9f3cf2143e2a9d78d2dccda8d54'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.427642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1353/2710] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:16 2022] DELETE /identity/v3/users/a087e9f3cf2143e2a9d78d2dccda8d54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:16.432102 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:16.432415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:16.432697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:16.450541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:16.451658 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:16.508907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1358/2711] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:16.519244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:16.520732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:16.575287 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca00a5-bce1-4a2d-81e8-3b6206c5aafd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:16.579495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:16.580118 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:16.580395 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:16.580666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:16.589392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:16.590835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:16.600486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1354/2712] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:16.861189 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:16.862920 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:16.877084 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb350b8-1804-4168-a10e-e4e5bd05378c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:16.881824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:16.882704 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:16.882984 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:16.886174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] PATH_INFO: `/v3/projects/1e6eadf0b3d146c6a40ba41d804eb9e1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:16.887397 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6eadf0b3d146c6a40ba41d804eb9e1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:16.889527 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:16.891398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:16.893101 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:16.939045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6eadf0b3d146c6a40ba41d804eb9e1', 'request_id': 'req-fe299463-b35c-4653-83bc-84ba84a540e1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.944185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6eadf0b3d146c6a40ba41d804eb9e1', 'request_id': 'req-fe299463-b35c-4653-83bc-84ba84a540e1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.950188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6eadf0b3d146c6a40ba41d804eb9e1', 'request_id': 'req-fe299463-b35c-4653-83bc-84ba84a540e1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.950969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e351-a4b0-4e34-8dec-9e6620edb3a6 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:16.963053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] The token cache is being invalidate because project 1e6eadf0b3d146c6a40ba41d804eb9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:16.963285 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.963904 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:16.965681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1359/2713] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:16 2022] DELETE /identity/v3/projects/1e6eadf0b3d146c6a40ba41d804eb9e1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:16.969573 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:16.970952 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:17.007959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.008604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.008887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.009160 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.010963 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:17.039473 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe299463-b35c-4653-83bc-84ba84a540e1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.045412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.046390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.047208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.047208 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] PATH_INFO: `/v3/users/c88a229aaabe4b76ba3b1f1584c32048` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.048275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88a229aaabe4b76ba3b1f1584c32048)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.050305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.073879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.076232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.091563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1355/2714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:17.115834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88a229aaabe4b76ba3b1f1584c32048'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.116500 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88a229aaabe4b76ba3b1f1584c32048'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.117111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88a229aaabe4b76ba3b1f1584c32048'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.130592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88a229aaabe4b76ba3b1f1584c32048'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.139297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1889a97c-25e6-44c7-93c5-cb41243ba7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88a229aaabe4b76ba3b1f1584c32048'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.154063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1360/2715] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:16 2022] DELETE /identity/v3/users/c88a229aaabe4b76ba3b1f1584c32048 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:17.436397 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.450232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28ca82-fb65-4aff-8042-2f61aef422ee service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.515886 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.516843 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.517195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.517568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] PATH_INFO: `/v3/projects/3023923106aa43c79d90be05eaf916bc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.518914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3023923106aa43c79d90be05eaf916bc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.520897 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.569196 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3023923106aa43c79d90be05eaf916bc', 'request_id': 'req-b8ce1348-7739-400e-8a43-bac0bc931afa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.574445 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3023923106aa43c79d90be05eaf916bc', 'request_id': 'req-b8ce1348-7739-400e-8a43-bac0bc931afa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.580975 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3023923106aa43c79d90be05eaf916bc', 'request_id': 'req-b8ce1348-7739-400e-8a43-bac0bc931afa'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.595502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] The token cache is being invalidate because project 3023923106aa43c79d90be05eaf916bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:17.595831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.596520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-b8ce1348-7739-400e-8a43-bac0bc931afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:17.598236 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1356/2716] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:17 2022] DELETE /identity/v3/projects/3023923106aa43c79d90be05eaf916bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:17.603045 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.603336 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.603616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.623562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:17.625030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:17.690392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1361/2717] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:17.698022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.698308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.698584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.717362 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:17.720045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:17.728183 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1357/2718] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:17.732465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.744123 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bfbb-ef7f-4560-8f7a-342f9c37c60e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.748916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.749715 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.750105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.750379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.751119 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:17.751541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.753140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.765863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1362/2719] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:04:17.770032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.779480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bbbd4-5479-4e9d-ba29-3fad9e9ec932 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.785141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.785816 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.786102 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.786380 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.787074 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.788991 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.814559 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1358/2720] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:17 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:17.818721 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.828731 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868acb5-3593-4248-8d6c-2eafcfd5d4b6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.884008 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.884648 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.884931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.885200 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.885906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.887776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.907948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1363/2721] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:17 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:17.912016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.923122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3599b-7f33-4a07-b230-ffdbc9c0061f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.927661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.928310 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.928588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.928856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.929568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.931547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.942666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1359/2722] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:17.946596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.957195 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334c64-b203-4879-8160-372ae3ad0f39 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.961907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.962554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.962836 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.963109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:17.963819 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:17.965403 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcbb09-1cf7-4285-b0ff-2b152bde8ba2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:17.977631 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1364/2723] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:17.981432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:17.992071 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d27b7-9152-4df6-ba2a-f85cc4019762 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:17.996849 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:17.997756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:17.998042 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:17.998315 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] PATH_INFO: `/v3/projects/5f3d66e8fe0b4fc68e26da9496f11ebf/users/894ad5e7b40b4159a33a053486011558/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:18.013882 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3d66e8fe0b4fc68e26da9496f11ebf, user_id=894ad5e7b40b4159a33a053486011558, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:18.017301 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:18.029505 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1360/2724] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:17 2022] PUT /identity/v3/projects/5f3d66e8fe0b4fc68e26da9496f11ebf/users/894ad5e7b40b4159a33a053486011558/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:18.091882 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:18.092197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:18.092494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:18.118621 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] MFA Rules not processed for user `894ad5e7b40b4159a33a053486011558`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:18.119794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:18.185913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1365/2725] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:18.200059 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:18.201894 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:18.260586 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbd3f5-3aab-4862-b9ca-99a34e38a00d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:18.264774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:18.266130 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:18.266409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:18.266682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:18.275727 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:18.277153 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bef47d-4179-45a1-b5f7-763f719e3620 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:18.287046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1361/2726] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:19.198650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:19.200110 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:19.266254 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ed5d-262d-4e62-ab91-37da9e103d30 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:19.271390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:19.272428 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:19.272732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:19.273006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] PATH_INFO: `/v3/users/b6309666f8d64df79b9363c7b6d5949e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:19.274209 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6309666f8d64df79b9363c7b6d5949e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:19.276179 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:19.330612 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6309666f8d64df79b9363c7b6d5949e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.331185 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6309666f8d64df79b9363c7b6d5949e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.331803 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6309666f8d64df79b9363c7b6d5949e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.344201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6309666f8d64df79b9363c7b6d5949e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.351905 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6309666f8d64df79b9363c7b6d5949e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.366477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1366/2727] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:19 2022] DELETE /identity/v3/users/b6309666f8d64df79b9363c7b6d5949e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:19.370844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:19.371309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:19.371309 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:19.388831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:19.390100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:19.456590 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1362/2728] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:19.463379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:19.464992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:19.524918 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb525e5-42c4-4223-8bc7-5ac2b0b4a64c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:19.532726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:19.532726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:19.533132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:19.533132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:19.544040 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:19.545476 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:19.555484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1367/2729] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:19.823705 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:19.825995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:19.845066 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f300e-46e8-4707-80bc-f1a125b2e690 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:19.850322 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:19.851235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:19.851520 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:19.851835 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] PATH_INFO: `/v3/projects/e172398f9f7d4da7be5cb484b1500a15` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:19.852969 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e172398f9f7d4da7be5cb484b1500a15)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:19.854892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:19.900808 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e172398f9f7d4da7be5cb484b1500a15', 'request_id': 'req-f62748fa-1a5e-4083-be57-71bd868172b4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.906693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e172398f9f7d4da7be5cb484b1500a15', 'request_id': 'req-f62748fa-1a5e-4083-be57-71bd868172b4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.912651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e172398f9f7d4da7be5cb484b1500a15', 'request_id': 'req-f62748fa-1a5e-4083-be57-71bd868172b4'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.924899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] The token cache is being invalidate because project e172398f9f7d4da7be5cb484b1500a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:19.925179 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.925826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:19.929829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1363/2730] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:19 2022] DELETE /identity/v3/projects/e172398f9f7d4da7be5cb484b1500a15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:19.931300 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:19.941999 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f20e0-3321-4a67-a77c-732780cc0950 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:20.004380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:20.005379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:20.005663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:20.005942 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] PATH_INFO: `/v3/users/e8fbeb0e704840ea88303086e97c2bfb` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:20.007152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fbeb0e704840ea88303086e97c2bfb)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:20.009426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:20.059359 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fbeb0e704840ea88303086e97c2bfb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.060096 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fbeb0e704840ea88303086e97c2bfb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.060729 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fbeb0e704840ea88303086e97c2bfb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.073619 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fbeb0e704840ea88303086e97c2bfb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.083522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fbeb0e704840ea88303086e97c2bfb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.105688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1368/2731] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:19 2022] DELETE /identity/v3/users/e8fbeb0e704840ea88303086e97c2bfb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:20.364133 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:20.365637 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:20.379373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62748fa-1a5e-4083-be57-71bd868172b4 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:20.439256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:20.440120 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:20.440406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:20.440684 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] PATH_INFO: `/v3/projects/b8924c595fef47b5aaa2519e45da1a92` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:20.441899 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8924c595fef47b5aaa2519e45da1a92)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:20.443814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:20.490282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8924c595fef47b5aaa2519e45da1a92', 'request_id': 'req-d48ab0c9-4950-4499-bdcd-fba03a025213'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.495347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8924c595fef47b5aaa2519e45da1a92', 'request_id': 'req-d48ab0c9-4950-4499-bdcd-fba03a025213'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.501827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8924c595fef47b5aaa2519e45da1a92', 'request_id': 'req-d48ab0c9-4950-4499-bdcd-fba03a025213'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.514212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] The token cache is being invalidate because project b8924c595fef47b5aaa2519e45da1a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:20.514496 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.515826 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.517547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1364/2732] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:20 2022] DELETE /identity/v3/projects/b8924c595fef47b5aaa2519e45da1a92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:20.521498 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:20.523042 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:20.536807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3f56-c5a5-48b4-a7c9-9442588cdf00 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:20.595266 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:20.596134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:20.596414 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:20.596686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] PATH_INFO: `/v3/users/4d282d24471045a9b16c5646f17b877c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:20.597892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d282d24471045a9b16c5646f17b877c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:20.599766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:20.645935 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d282d24471045a9b16c5646f17b877c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.646537 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d282d24471045a9b16c5646f17b877c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.647133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d282d24471045a9b16c5646f17b877c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.659127 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d282d24471045a9b16c5646f17b877c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.666252 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a00796f3-2661-4adf-b17a-d1840b0d76ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d282d24471045a9b16c5646f17b877c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:20.678921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1369/2733] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:20 2022] DELETE /identity/v3/users/4d282d24471045a9b16c5646f17b877c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:21.137096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.138670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:21.152356 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ab0c9-4950-4499-bdcd-fba03a025213 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.226988 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.227847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.228126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.228401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] PATH_INFO: `/v3/projects/d53958de050345a3ab5df291cc77d417` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.229571 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53958de050345a3ab5df291cc77d417)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.231749 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.285440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53958de050345a3ab5df291cc77d417', 'request_id': 'req-86d44bac-fd26-4803-8cdc-c29e20964e4d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:21.295145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53958de050345a3ab5df291cc77d417', 'request_id': 'req-86d44bac-fd26-4803-8cdc-c29e20964e4d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:21.303412 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53958de050345a3ab5df291cc77d417', 'request_id': 'req-86d44bac-fd26-4803-8cdc-c29e20964e4d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:21.321150 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] The token cache is being invalidate because project d53958de050345a3ab5df291cc77d417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:21.321437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:21.322497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-86d44bac-fd26-4803-8cdc-c29e20964e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:21.324369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1365/2734] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:21 2022] DELETE /identity/v3/projects/d53958de050345a3ab5df291cc77d417 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:21.330604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.330992 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.331364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.351142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:21.352456 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:21.411470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1370/2735] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:21.419860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.420401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.420401 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.443460 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:21.444719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:21.453516 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1366/2736] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:21.457232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.475116 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619057-3f53-42b5-80cc-d17ed31f5b2f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.480182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.480868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.481151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.481429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.482205 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:21.482517 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.484730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.497703 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1371/2737] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:04:21.502391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.512230 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c668e6f-e30c-4314-9b17-792528f607b2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.517467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.518240 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.518581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.518923 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.519688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.521830 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.551732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1367/2738] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:21.555782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.566596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0627-967c-4467-8e08-2314e6e17986 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.627458 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.628128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.628410 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.628686 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.629825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.631303 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.651644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1372/2739] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:21.657089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.667650 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84559-85b4-458b-b843-0491f942240b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.673682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.674479 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.674768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.675046 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.675767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.677361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.688137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1368/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:21.692047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.704207 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02167ac6-ab5b-48f4-8775-9da70735da02 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.710991 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.711723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.711958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.712264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.713017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.714657 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863360-71e2-4880-969c-7c87b0a664ba admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.726291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1373/2741] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:21.730414 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:21.746361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e206c-284c-4794-8d0f-1021d419427a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:21.752159 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:21.753227 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.753430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.754351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] PATH_INFO: `/v3/projects/28394714d85644f2a2591e5c5481706f/users/308da1f44f4a478c9eede67cd04d739d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.773967 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28394714d85644f2a2591e5c5481706f, user_id=308da1f44f4a478c9eede67cd04d739d, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:21.776729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:21.809682 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1369/2742] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:21 2022] PUT /identity/v3/projects/28394714d85644f2a2591e5c5481706f/users/308da1f44f4a478c9eede67cd04d739d/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:21.879494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:21.880134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:21.880650 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:21.914289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] MFA Rules not processed for user `308da1f44f4a478c9eede67cd04d739d`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:21.916380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:21.991455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1374/2743] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:21.996105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.069047 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2c0b4-f26c-4270-a9df-db56a6903c00 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.073577 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.074264 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.074551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.074827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.075523 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.078096 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.104184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1370/2744] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:21 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:22.108376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.120074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d0eb-5a90-419f-adc2-842e9a4d7f2f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.179355 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.180059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.180334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.180605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.181351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.183280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.206039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1375/2745] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:22 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:22.210200 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.222744 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d499d8-9735-4cfc-a62e-3ddf84aa95de admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.230741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.231935 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.232279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.232600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.233495 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.235452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.251601 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1371/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:22.256931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.270327 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a165f6-39db-4042-97e9-85efc948565a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.275435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.276364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.276649 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.276926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] PATH_INFO: `/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0/users/5698540f47344a73a535e92f27785dbc/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.294297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1900ba4f5fa4ca5b90d22e7a331d6c0, user_id=5698540f47344a73a535e92f27785dbc, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.297172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.310879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1376/2747] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:22 2022] PUT /identity/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0/users/5698540f47344a73a535e92f27785dbc/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:22.316193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.327868 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b606b1-59db-45fc-98fd-ce2ffddd3a9c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.404494 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.405219 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.405579 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.405887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.406600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.408243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd027-b7a7-48ca-b809-01c2180bbb0b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.419939 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1372/2748] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:22.425927 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.440605 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c70c-d39f-4277-94e3-7a6c954a0a4b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.446869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.447834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.448091 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.448392 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] PATH_INFO: `/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0/users/5698540f47344a73a535e92f27785dbc/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.450841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1900ba4f5fa4ca5b90d22e7a331d6c0, user_id=5698540f47344a73a535e92f27785dbc, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.454457 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.465877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1377/2749] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:22 2022] PUT /identity/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0/users/5698540f47344a73a535e92f27785dbc/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:22.478774 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.479216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.479609 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.510591 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] MFA Rules not processed for user `5698540f47344a73a535e92f27785dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:22.512009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:22.580687 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1373/2750] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:22.592637 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.595305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:22.657561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce87-eb03-4946-a79f-de643656fcf5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.661477 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.662309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.662576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.663027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.672976 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.674435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.685404 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1378/2751] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:22.771428 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:22.781304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72083a2c-8b8b-44f6-971e-09f624b2ee7c None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:22.784896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:22.785543 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:22.785860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:22.786135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:22.846879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:22.848374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:22.857932 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1374/2752] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:26.024026 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:26.025406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:26.080089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e4eb-1c17-4f27-83a3-efdd87a85283 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:26.083644 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:26.084277 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:26.084556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:26.084825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:26.086558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:26.146762 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:26.148178 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0a5c-3172-43d2-a0ca-45bd2957ab7c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:26.157860 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1379/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:29.024097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:29.038361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9163f-3b0f-4841-8073-f8de84ef51f7 service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:29.043602 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:29.044561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.044904 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.045404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] PATH_INFO: `/v3/users/308da1f44f4a478c9eede67cd04d739d` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.047221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308da1f44f4a478c9eede67cd04d739d)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:29.049728 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:29.137827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308da1f44f4a478c9eede67cd04d739d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.139061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308da1f44f4a478c9eede67cd04d739d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.140465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308da1f44f4a478c9eede67cd04d739d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.164581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308da1f44f4a478c9eede67cd04d739d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.177702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308da1f44f4a478c9eede67cd04d739d'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.194745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1375/2754] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:29 2022] DELETE /identity/v3/users/308da1f44f4a478c9eede67cd04d739d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:29.199597 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.200643 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.201027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.225159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:29.226469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:29.322093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1380/2755] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:29.335555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:29.336998 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:29.451693 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a9ae-dd1f-4348-ae5d-129358f78fb6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:29.460715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:29.460715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.460715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.460715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.487194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:29.488814 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:29.500594 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1376/2756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:29.550806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:29.553314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:29.581948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712635d9-669c-47c6-9e5d-624cb7c99abc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:29.587222 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:29.588098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.588381 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.588655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] PATH_INFO: `/v3/users/6239d81f06714c63ae74423b432ea583` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.589893 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6239d81f06714c63ae74423b432ea583)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:29.591789 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:29.651877 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6239d81f06714c63ae74423b432ea583'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.652656 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6239d81f06714c63ae74423b432ea583'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.653384 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6239d81f06714c63ae74423b432ea583'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.670569 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6239d81f06714c63ae74423b432ea583'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.687842 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6239d81f06714c63ae74423b432ea583'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:29.694508 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1381/2757] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:29 2022] DELETE /identity/v3/users/6239d81f06714c63ae74423b432ea583 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:29.796121 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:29.797863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:29.818367 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146013a-d29a-4ac4-b239-e90e86c232ed service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:29.891164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:29.894009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:29.906147 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:29.907470 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.907791 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.908036 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] PATH_INFO: `/v3/projects/28394714d85644f2a2591e5c5481706f` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.909273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28394714d85644f2a2591e5c5481706f)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:29.911249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:29.923596 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e648-3b0b-4766-9b0e-4c0e6020a3aa admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:29.929742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:29.930705 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:29.931196 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:29.931380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] PATH_INFO: `/v3/projects/2a58ec5ecdf84164a57e7d78d5dcecd1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:29.932706 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a58ec5ecdf84164a57e7d78d5dcecd1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:29.934861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.007554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28394714d85644f2a2591e5c5481706f', 'request_id': 'req-172a55d6-e402-44fd-8e03-62adf230133a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.008105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a58ec5ecdf84164a57e7d78d5dcecd1', 'request_id': 'req-4db52443-7103-4bf9-ac99-15c898208513'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.014544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28394714d85644f2a2591e5c5481706f', 'request_id': 'req-172a55d6-e402-44fd-8e03-62adf230133a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.015118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a58ec5ecdf84164a57e7d78d5dcecd1', 'request_id': 'req-4db52443-7103-4bf9-ac99-15c898208513'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.021489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28394714d85644f2a2591e5c5481706f', 'request_id': 'req-172a55d6-e402-44fd-8e03-62adf230133a'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.022003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a58ec5ecdf84164a57e7d78d5dcecd1', 'request_id': 'req-4db52443-7103-4bf9-ac99-15c898208513'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.035771 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] The token cache is being invalidate because project 28394714d85644f2a2591e5c5481706f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:30.036348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.036905 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.037849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] The token cache is being invalidate because project 2a58ec5ecdf84164a57e7d78d5dcecd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:30.038143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.043538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4db52443-7103-4bf9-ac99-15c898208513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.043840 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1377/2758] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:29 2022] DELETE /identity/v3/projects/28394714d85644f2a2591e5c5481706f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:30.043944 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1382/2759] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:29 2022] DELETE /identity/v3/projects/2a58ec5ecdf84164a57e7d78d5dcecd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:30.044038 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.044142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.046353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a145bc-9d10-4cbe-87f2-e82b4cb3d6f2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.046725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a145bc-9d10-4cbe-87f2-e82b4cb3d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.046996 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a145bc-9d10-4cbe-87f2-e82b4cb3d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.066291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-15a145bc-9d10-4cbe-87f2-e82b4cb3d6f2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:30.067557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-15a145bc-9d10-4cbe-87f2-e82b4cb3d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.109946 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a55d6-e402-44fd-8e03-62adf230133a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.114670 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.115535 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.115820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.116103 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] PATH_INFO: `/v3/users/5698540f47344a73a535e92f27785dbc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.117284 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5698540f47344a73a535e92f27785dbc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.119244 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.127364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1383/2760] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:30.135767 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.136083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.136330 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.157568 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:30.158848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.166381 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5698540f47344a73a535e92f27785dbc'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.166778 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1384/2761] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:30.167021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5698540f47344a73a535e92f27785dbc'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.167709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5698540f47344a73a535e92f27785dbc'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.171046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.179702 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25c00-abb7-4206-855d-dc26a3cd62d1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.180646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5698540f47344a73a535e92f27785dbc'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.184488 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.185131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.185495 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.185714 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.186613 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:30.187153 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.188455 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.189001 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5698540f47344a73a535e92f27785dbc'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.200147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1385/2762] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:04:30.200714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1378/2763] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:30 2022] DELETE /identity/v3/users/5698540f47344a73a535e92f27785dbc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:30.204971 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.206670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.219668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff0d2-1c55-42dc-8408-509270849ddb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.278780 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.279353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.279639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.279917 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.281241 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.283305 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.309388 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1386/2764] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:30.314671 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.324502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490991-113f-4956-9639-032cc861b4ef admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.386013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.387022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.387394 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.387770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.388800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.391606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.411834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1379/2765] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:30.415910 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.427046 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c9a0d-d617-4878-a946-46524cc95e73 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.435764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.437873 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.438229 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.438771 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.439489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.441074 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.451464 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1387/2766] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:30.456767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.467228 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246509ae-f8b0-41bc-b009-ab1cbbf8d813 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.476633 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.477303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.477581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.477889 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.478610 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.480672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.482006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.484309 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.493836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1380/2767] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:30.496827 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.501226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d379c2-e921-4bc7-abf4-d180500a8d29 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.508681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.509013 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a606a6-97e0-45b2-bfef-bd65452d0485 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.509666 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.509855 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.510131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] PATH_INFO: `/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.511297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1900ba4f5fa4ca5b90d22e7a331d6c0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.513216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.513592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.515122 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.516016 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.516296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] PATH_INFO: `/v3/projects/cb5d22b94ffb459f89624748345e54cd/users/50acd2c3813a44b3b7bcdf600eaf8996/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.532910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5d22b94ffb459f89624748345e54cd, user_id=50acd2c3813a44b3b7bcdf600eaf8996, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.535490 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a0f3a-3ef0-4913-b07a-12c6a24b0fa9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.549021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1381/2768] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:30 2022] PUT /identity/v3/projects/cb5d22b94ffb459f89624748345e54cd/users/50acd2c3813a44b3b7bcdf600eaf8996/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:30.559081 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.559405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.559773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.560166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1900ba4f5fa4ca5b90d22e7a331d6c0', 'request_id': 'req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.566659 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1900ba4f5fa4ca5b90d22e7a331d6c0', 'request_id': 'req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.573184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1900ba4f5fa4ca5b90d22e7a331d6c0', 'request_id': 'req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.586776 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] The token cache is being invalidate because project f1900ba4f5fa4ca5b90d22e7a331d6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:30.587060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.587700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-f80c6c21-a38d-4fcb-a151-eafb4ca72b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:30.589279 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1388/2769] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:30 2022] DELETE /identity/v3/projects/f1900ba4f5fa4ca5b90d22e7a331d6c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:30.592511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] MFA Rules not processed for user `50acd2c3813a44b3b7bcdf600eaf8996`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:30.594291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793254-5541-4fc2-b4f4-b2c1c1bccb4e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.594446 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.594562 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793254-5541-4fc2-b4f4-b2c1c1bccb4e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.594840 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793254-5541-4fc2-b4f4-b2c1c1bccb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.612557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-27793254-5541-4fc2-b4f4-b2c1c1bccb4e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:30.613758 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-27793254-5541-4fc2-b4f4-b2c1c1bccb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.658215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1382/2770] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:30.662413 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.663709 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.671677 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1389/2771] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:30.677156 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f0c7-4ed6-4786-b237-08eafa47f2e7 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.679594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.680030 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.680314 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.681938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.682582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.682857 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.683127 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.683803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.685675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.698668 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:30.699861 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:30.709521 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1390/2772] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:30.712254 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1383/2773] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:30.713595 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.716024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.722880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918e578-7f0d-42b9-a20a-3c37aa31ba9f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.779246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af73d-4c38-48e0-be4c-59c2fcc9ceb6 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.779843 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.781399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.781786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.782059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.782782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:30.783142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.784660 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.785112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.785874 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.786226 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.786574 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.787333 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.789318 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.796446 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1391/2774] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:04:30.801299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.812222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1384/2775] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:30.812890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed6ebb-2277-4d6a-91df-be420a96c64c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.816409 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.818201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.818892 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.819299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.819611 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.820331 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.822774 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.826078 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605af3-239f-448a-8b3a-c33c20838c0b admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.831518 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.832184 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.832467 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.832745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.833466 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.835082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.846009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1385/2776] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:04:30.849990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.850645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1392/2777] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:30.856089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.865829 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b1965-4db5-410c-b914-ad61a05bdc55 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.918674 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737e08-b3ce-4462-a66a-98dcb9c78e8e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:30.923737 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.923916 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:30.924422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.924621 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:30.924732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.924954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.925062 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:30.925296 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] PATH_INFO: `/v3/projects/631f89340c334826b477159a71e478fd/users/244164822eb2459e92c5be5840fbd5d5/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:30.925625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.927548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.941622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f89340c334826b477159a71e478fd, user_id=244164822eb2459e92c5be5840fbd5d5, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:30.944372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:30.947663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1393/2778] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:30 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:30.952901 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.958235 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1386/2779] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:30 2022] PUT /identity/v3/projects/631f89340c334826b477159a71e478fd/users/244164822eb2459e92c5be5840fbd5d5/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:30.962372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:30.962679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757442-eef7-4ef0-a23b-cfa3f8d01933 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.022034 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.022764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced129fa-fb1b-4788-92a3-a4205e41e0a8 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.023043 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.023587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.024106 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.025108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.027115 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.027712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.028364 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.028643 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.028915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.029635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.032421 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.041501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1394/2780] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:31.046303 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1387/2781] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:31.052497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.052653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.063159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ad66-6cee-437b-9e82-33ab35a6c2b1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.063344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91697d-fb50-4cfc-bebb-7f1e475af50e admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.068253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.068906 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.069204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.069475 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.069694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.070278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.070576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.070861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.071137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] PATH_INFO: `/v3/projects/631f89340c334826b477159a71e478fd/users/244164822eb2459e92c5be5840fbd5d5/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.071853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.073221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f89340c334826b477159a71e478fd, user_id=244164822eb2459e92c5be5840fbd5d5, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.076146 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5d431-5294-4c8b-8674-877c95e21915 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.083113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1395/2782] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:31.087424 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.087764 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1388/2783] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:31 2022] PUT /identity/v3/projects/631f89340c334826b477159a71e478fd/users/244164822eb2459e92c5be5840fbd5d5/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:31.105015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.105015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.105015 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.105288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2026-29e8-47bb-9fba-03fba11d45b2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.128032 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] MFA Rules not processed for user `244164822eb2459e92c5be5840fbd5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:31.129304 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:31.170809 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.171716 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.171997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.172275 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] PATH_INFO: `/v3/projects/7fd07eea47e74751a675a4049032fb67/users/59abce35e1c64e4d8a034d35cdb8161b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.189580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd07eea47e74751a675a4049032fb67, user_id=59abce35e1c64e4d8a034d35cdb8161b, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.192720 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f44a-a1da-4dc5-8677-1d6dddbf4a6c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.205390 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1389/2784] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:31.214412 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1396/2785] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:31 2022] PUT /identity/v3/projects/7fd07eea47e74751a675a4049032fb67/users/59abce35e1c64e4d8a034d35cdb8161b/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:31.220933 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.222441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:31.224459 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.224743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.225017 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.250824 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] MFA Rules not processed for user `59abce35e1c64e4d8a034d35cdb8161b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:31.252041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:31.279681 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fb21-1047-4ebf-8d87-aa3a63598fc9 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.317311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1397/2786] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:31.329307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.329589 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.329993 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.330283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.330560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.331164 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:31.343451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f9ed-237d-4615-b758-1636546d8566 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.347422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.348076 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.348370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.348646 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.360080 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.362603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.372577 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1398/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:04:31.395308 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.396745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fd8a5-a682-46a7-9058-70b80eb154e3 service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.407375 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1390/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:31.817054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:31.877585 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f6374-a97a-44fa-8b27-08e622e1178e service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:31.882020 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:31.882875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.883151 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.883422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] PATH_INFO: `/v3/users/50acd2c3813a44b3b7bcdf600eaf8996` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.884587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50acd2c3813a44b3b7bcdf600eaf8996)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:31.886515 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:31.929814 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50acd2c3813a44b3b7bcdf600eaf8996'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:31.930453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50acd2c3813a44b3b7bcdf600eaf8996'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:31.931050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50acd2c3813a44b3b7bcdf600eaf8996'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:31.942513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50acd2c3813a44b3b7bcdf600eaf8996'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:31.949452 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50acd2c3813a44b3b7bcdf600eaf8996'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:31.961639 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1399/2789] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:31 2022] DELETE /identity/v3/users/50acd2c3813a44b3b7bcdf600eaf8996 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:31.966351 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:31.966639 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:31.966914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:31.985463 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:31.986660 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:32.045034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1391/2790] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:32.055925 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:32.057352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:32.112967 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78566e1-5e78-4124-93ae-5f4da6e4d18b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:32.117033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:32.117689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:32.117974 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:32.118307 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:32.127299 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:32.128770 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:32.137913 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1400/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:32.414061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:32.415561 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:32.431190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57e62-d6e0-41e8-8f81-61682c0ad9e5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:32.438879 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:32.439714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:32.440049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:32.440279 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] PATH_INFO: `/v3/projects/cb5d22b94ffb459f89624748345e54cd` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:32.441486 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5d22b94ffb459f89624748345e54cd)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:32.443371 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:32.489942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5d22b94ffb459f89624748345e54cd', 'request_id': 'req-3093f628-b126-4157-99f2-897e4d165c92'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.495475 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5d22b94ffb459f89624748345e54cd', 'request_id': 'req-3093f628-b126-4157-99f2-897e4d165c92'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.502088 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5d22b94ffb459f89624748345e54cd', 'request_id': 'req-3093f628-b126-4157-99f2-897e4d165c92'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.515275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] The token cache is being invalidate because project cb5d22b94ffb459f89624748345e54cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:32.515563 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.516181 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.517926 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1392/2792] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:32 2022] DELETE /identity/v3/projects/cb5d22b94ffb459f89624748345e54cd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:32.522037 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:32.531837 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696217e-5c7d-496a-9e28-a19f5a2f193a service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:32.590023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:32.590921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:32.591225 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:32.591614 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] PATH_INFO: `/v3/users/244164822eb2459e92c5be5840fbd5d5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:32.593422 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244164822eb2459e92c5be5840fbd5d5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:32.595367 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:32.640244 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244164822eb2459e92c5be5840fbd5d5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.640907 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244164822eb2459e92c5be5840fbd5d5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.641509 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244164822eb2459e92c5be5840fbd5d5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.652539 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244164822eb2459e92c5be5840fbd5d5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.659551 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-131a77bf-140f-4fde-8781-03ca05010b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244164822eb2459e92c5be5840fbd5d5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:32.671067 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1401/2793] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:32 2022] DELETE /identity/v3/users/244164822eb2459e92c5be5840fbd5d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:04:32.959269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:32.960800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:32.975742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f628-b126-4157-99f2-897e4d165c92 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.031715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.032636 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.032920 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.033195 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] PATH_INFO: `/v3/projects/631f89340c334826b477159a71e478fd` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.034501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631f89340c334826b477159a71e478fd)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.036453 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.083588 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631f89340c334826b477159a71e478fd', 'request_id': 'req-ad5b113a-0ee3-4924-946c-227ad9f3c558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:33.088981 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631f89340c334826b477159a71e478fd', 'request_id': 'req-ad5b113a-0ee3-4924-946c-227ad9f3c558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:33.095690 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631f89340c334826b477159a71e478fd', 'request_id': 'req-ad5b113a-0ee3-4924-946c-227ad9f3c558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:33.107641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] The token cache is being invalidate because project 631f89340c334826b477159a71e478fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:33.107924 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:33.108635 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-ad5b113a-0ee3-4924-946c-227ad9f3c558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:33.110245 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1393/2794] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:32 2022] DELETE /identity/v3/projects/631f89340c334826b477159a71e478fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:33.115380 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.115670 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.115960 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.136055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:33.137239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:33.194608 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1402/2795] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:04:33.203242 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.203465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.203741 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.222656 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:33.223865 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:33.232482 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1394/2796] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:33.236880 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.246679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788768-a3c5-47d6-b97b-d2f8b407fb04 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.252158 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.252812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.253107 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.253370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.254171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:04:33.254474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.256072 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.268575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1403/2797] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:04:33.273034 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.282712 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605f8f3-22b8-40cf-9968-0bab5e0f9f5e None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.287449 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.288100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.288389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.288658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] PATH_INFO: `/v3/projects` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.289354 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.291532 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.317327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1395/2798] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:04:33 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:04:33.321518 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.331858 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2851f5-0834-436d-95a5-6761dd03bf4b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.398956 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.399665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.399954 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.400226 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.400948 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.402926 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.426099 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1404/2799] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:04:33 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:04:33.432022 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.443768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c8a4a-1184-4663-8a94-513a12c86878 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.448686 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.449427 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.449854 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.450045 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.450760 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.452909 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.465750 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1396/2800] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:33.467876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.479856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc11b-333c-4add-a415-d8606c5ae095 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.485268 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.486047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.486411 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.486723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.487505 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.489147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed9409-6c9d-4c68-a701-9dffaa5667d8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.501688 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1405/2801] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:04:33.504215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.515255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05982-5de6-40fe-b397-13954fe4b162 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.521180 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.522142 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.522540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.522852 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] PATH_INFO: `/v3/projects/5dd308d377ba4901b69b2312c4248591/users/8bc79492e9ae447da53b8302ddacf722/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.539347 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd308d377ba4901b69b2312c4248591, user_id=8bc79492e9ae447da53b8302ddacf722, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.543529 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.557043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1397/2802] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:04:33 2022] PUT /identity/v3/projects/5dd308d377ba4901b69b2312c4248591/users/8bc79492e9ae447da53b8302ddacf722/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:33.568890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.569398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.569622 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.597281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] MFA Rules not processed for user `8bc79492e9ae447da53b8302ddacf722`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:33.598565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:33.671557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1406/2803] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:33.683283 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.685010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:33.746388 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0969f-f0e2-46ad-a395-ffd0896e19fd admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:33.750165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:33.750828 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:33.751107 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:33.751376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:33.760555 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:33.762049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240dc35-fb23-4806-ae6e-cdbaba3987bd service glance] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:33.772547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1398/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:33.941152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:33.943322 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:34.021426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cd251-af38-4384-95ba-bbc83bfd8c0d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:34.027558 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:34.028444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:34.028727 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:34.029003 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] PATH_INFO: `/v3/users/59abce35e1c64e4d8a034d35cdb8161b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:34.030445 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59abce35e1c64e4d8a034d35cdb8161b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:34.032461 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:34.082685 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59abce35e1c64e4d8a034d35cdb8161b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.083353 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59abce35e1c64e4d8a034d35cdb8161b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.084016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59abce35e1c64e4d8a034d35cdb8161b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.096579 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59abce35e1c64e4d8a034d35cdb8161b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.104183 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59abce35e1c64e4d8a034d35cdb8161b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.117216 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1407/2805] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:04:33 2022] DELETE /identity/v3/users/59abce35e1c64e4d8a034d35cdb8161b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:04:34.121942 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:34.122398 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:34.122742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:34.140781 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:04:34.142132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:34.212464 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1399/2806] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:04:34.220038 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:34.221804 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:34.287540 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdbdf5-0b76-4b58-9b38-a0b5d262049f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:34.291101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:34.291765 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:34.292041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:34.292311 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:34.302128 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:34.303538 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:34.313108 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1408/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:04:34.600863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:04:34.602374 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:04:34.614746 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c71ec-77ab-4481-8c87-6c49d8e40dda None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:04:34.619517 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:04:34.620366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:04:34.620642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:04:34.620911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] PATH_INFO: `/v3/projects/7fd07eea47e74751a675a4049032fb67` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:04:34.622145 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd07eea47e74751a675a4049032fb67)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:04:34.624582 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:04:34.679673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd07eea47e74751a675a4049032fb67', 'request_id': 'req-34ef92cc-b890-46d4-a0e4-bd7b85812d02'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.684867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd07eea47e74751a675a4049032fb67', 'request_id': 'req-34ef92cc-b890-46d4-a0e4-bd7b85812d02'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.692483 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd07eea47e74751a675a4049032fb67', 'request_id': 'req-34ef92cc-b890-46d4-a0e4-bd7b85812d02'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.706123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] The token cache is being invalidate because project 7fd07eea47e74751a675a4049032fb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:04:34.706411 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.707035 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-34ef92cc-b890-46d4-a0e4-bd7b85812d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:04:34.708572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1400/2808] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:04:34 2022] DELETE /identity/v3/projects/7fd07eea47e74751a675a4049032fb67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:05:03.048182 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:03.049557 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:03.116653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59dfd5-44a7-4a35-9f6e-f8039bf72246 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:03.176413 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:03.177469 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:03.177791 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:03.178144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:03.180436 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:03.193261 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:03.195197 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:03.207335 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1409/2809] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:04.005906 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:04.006426 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:04.006606 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:04.030873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] MFA Rules not processed for user `b22700cae020412589e7bfdbb00e91bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:04.032343 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:04.106167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1401/2810] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 5 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:04.155460 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:04.157513 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:04.245340 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c2e67-e81d-4d86-a0e0-7921beed83d2 service placement] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:04.251264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f29b5255954eb7acd1c00773731200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:04.251928 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:04.252306 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:04.252587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:04.261556 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:04.263167 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e5b8-048d-4180-aa25-083f61eef6eb service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:04.272408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1410/2811] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 5 15:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:05:06.225275 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:06.226732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:06.294583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43205874-0d32-4b8e-8d8f-54eb943480c8 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:06.299652 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:06.300519 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:06.300800 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:06.301075 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] PATH_INFO: `/v3/users/894ad5e7b40b4159a33a053486011558` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:06.302270 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894ad5e7b40b4159a33a053486011558)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:06.304189 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:06.356369 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894ad5e7b40b4159a33a053486011558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:06.357026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894ad5e7b40b4159a33a053486011558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:06.357638 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894ad5e7b40b4159a33a053486011558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:06.370729 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894ad5e7b40b4159a33a053486011558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:06.379714 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894ad5e7b40b4159a33a053486011558'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:06.400405 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1402/2812] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:05:06 2022] DELETE /identity/v3/users/894ad5e7b40b4159a33a053486011558 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:06.406501 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:06.407402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:06.407871 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:06.433211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:06.434969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:06.502663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1411/2813] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:06.512619 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:06.514165 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:06.576747 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da48c-52b4-404f-aa57-156e21922a86 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:06.581700 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:06.582430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:06.582716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:06.582999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:06.594014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:06.595525 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:06.606097 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1403/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:05:06.925845 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:06.927467 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:06.947862 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b77c6-bc06-4512-af65-3dcbdf487069 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:06.953054 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:06.954078 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:06.954958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:06.955812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] PATH_INFO: `/v3/projects/5f3d66e8fe0b4fc68e26da9496f11ebf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:06.957069 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3d66e8fe0b4fc68e26da9496f11ebf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:06.959060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:07.005849 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3d66e8fe0b4fc68e26da9496f11ebf', 'request_id': 'req-15424ae0-7713-4c8f-b73c-82ee3014eb08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:07.011465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3d66e8fe0b4fc68e26da9496f11ebf', 'request_id': 'req-15424ae0-7713-4c8f-b73c-82ee3014eb08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:07.018418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3d66e8fe0b4fc68e26da9496f11ebf', 'request_id': 'req-15424ae0-7713-4c8f-b73c-82ee3014eb08'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:07.031218 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] The token cache is being invalidate because project 5f3d66e8fe0b4fc68e26da9496f11ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:05:07.031559 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:07.032184 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:07.033757 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1412/2815] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:05:06 2022] DELETE /identity/v3/projects/5f3d66e8fe0b4fc68e26da9496f11ebf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:10.905896 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:10.908010 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:10.924918 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eea1c-cd7c-424f-abe3-b56f5d5d1f7b service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:10.989193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:10.989193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:10.989193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:10.989193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] PATH_INFO: `/v3/users/7f47adc5a3b44275b1f4a80033464768` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:10.991752 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f47adc5a3b44275b1f4a80033464768)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:10.993707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:11.039598 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f47adc5a3b44275b1f4a80033464768'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.040243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f47adc5a3b44275b1f4a80033464768'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.040856 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f47adc5a3b44275b1f4a80033464768'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.053268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f47adc5a3b44275b1f4a80033464768'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.061339 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f47adc5a3b44275b1f4a80033464768'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.077282 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1404/2816] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:05:10 2022] DELETE /identity/v3/users/7f47adc5a3b44275b1f4a80033464768 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:11.250958 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:11.252438 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:11.265793 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424ae0-7713-4c8f-b73c-82ee3014eb08 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:11.323951 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:11.324841 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:11.325129 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:11.325418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] PATH_INFO: `/v3/projects/d4af07bd8d7141af97fb4bf0e8168e9f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:11.327198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4af07bd8d7141af97fb4bf0e8168e9f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:11.329162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:11.373471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4af07bd8d7141af97fb4bf0e8168e9f', 'request_id': 'req-662f7963-35cd-4824-953f-e3827013db03'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.378604 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4af07bd8d7141af97fb4bf0e8168e9f', 'request_id': 'req-662f7963-35cd-4824-953f-e3827013db03'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.384425 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4af07bd8d7141af97fb4bf0e8168e9f', 'request_id': 'req-662f7963-35cd-4824-953f-e3827013db03'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.397431 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] The token cache is being invalidate because project d4af07bd8d7141af97fb4bf0e8168e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:05:11.397831 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.398502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.400047 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1413/2817] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:05:11 2022] DELETE /identity/v3/projects/d4af07bd8d7141af97fb4bf0e8168e9f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:11.404100 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:11.406452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:11.419873 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea05c-3fdf-4448-ab6f-a6397ae436a9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:11.477792 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:11.478666 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:11.478951 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:11.479232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] PATH_INFO: `/v3/users/6ee91e1e9cbe4780a6419b80d91773f6` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:11.480441 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee91e1e9cbe4780a6419b80d91773f6)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:11.482391 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:11.526718 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee91e1e9cbe4780a6419b80d91773f6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.527454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee91e1e9cbe4780a6419b80d91773f6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.528054 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee91e1e9cbe4780a6419b80d91773f6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.540295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee91e1e9cbe4780a6419b80d91773f6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.547269 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee91e1e9cbe4780a6419b80d91773f6'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.558914 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1405/2818] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:05:11 2022] DELETE /identity/v3/users/6ee91e1e9cbe4780a6419b80d91773f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:11.728979 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:11.730487 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:11.744700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7963-35cd-4824-953f-e3827013db03 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:11.800701 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:11.801548 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:11.801853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:11.802125 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] PATH_INFO: `/v3/projects/9fd84f07f7914bf399cf1c9c8de329df` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:11.803264 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd84f07f7914bf399cf1c9c8de329df)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:11.805133 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:11.850470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd84f07f7914bf399cf1c9c8de329df', 'request_id': 'req-da691624-ccfd-4ce1-bc39-776d17280059'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.855610 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd84f07f7914bf399cf1c9c8de329df', 'request_id': 'req-da691624-ccfd-4ce1-bc39-776d17280059'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.862191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd84f07f7914bf399cf1c9c8de329df', 'request_id': 'req-da691624-ccfd-4ce1-bc39-776d17280059'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.875101 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] The token cache is being invalidate because project 9fd84f07f7914bf399cf1c9c8de329df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:05:11.875375 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.875997 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da691624-ccfd-4ce1-bc39-776d17280059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:11.877561 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1414/2819] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:05:11 2022] DELETE /identity/v3/projects/9fd84f07f7914bf399cf1c9c8de329df => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:14.438617 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:14.440044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:14.452921 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb56b4-00ca-45e1-ade4-95594b90ec24 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:14.507863 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:14.508732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:14.509014 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:14.509291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] PATH_INFO: `/v3/users/8bc79492e9ae447da53b8302ddacf722` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:14.510501 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc79492e9ae447da53b8302ddacf722)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:14.512429 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:14.556255 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc79492e9ae447da53b8302ddacf722'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:14.556885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc79492e9ae447da53b8302ddacf722'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:14.557477 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc79492e9ae447da53b8302ddacf722'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:14.570020 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc79492e9ae447da53b8302ddacf722'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:14.577661 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc79492e9ae447da53b8302ddacf722'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:14.589350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1406/2820] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:05:14 2022] DELETE /identity/v3/users/8bc79492e9ae447da53b8302ddacf722 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:14.594531 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:14.595000 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:14.595122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:14.612131 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:14.613402 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:14.670752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1415/2821] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:14.680320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:14.681717 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:14.737137 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f432-fba2-4c92-b037-a94a27ef5c9f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:14.740742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:14.741372 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:14.741678 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:14.741966 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:14.751173 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:14.752589 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e46ae-98e6-48bb-85e5-eda1444e96a0 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:14.761692 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1407/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:15.019334 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.020834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:15.033909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06826ef-aca3-43bc-9e21-27e8e5e0f177 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.038522 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.039405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.039684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.039966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] PATH_INFO: `/v3/projects/5dd308d377ba4901b69b2312c4248591` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.041248 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd308d377ba4901b69b2312c4248591)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.043083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.088915 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd308d377ba4901b69b2312c4248591', 'request_id': 'req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:15.094898 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd308d377ba4901b69b2312c4248591', 'request_id': 'req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:15.101039 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd308d377ba4901b69b2312c4248591', 'request_id': 'req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:15.113779 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] The token cache is being invalidate because project 5dd308d377ba4901b69b2312c4248591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:05:15.114064 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:15.114684 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9bd5f28b-5c95-41e6-840e-bf5c34c833e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:15.116260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1416/2823] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:05:15 2022] DELETE /identity/v3/projects/5dd308d377ba4901b69b2312c4248591 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:15.121086 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.121402 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.121715 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.139547 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:15.140723 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:15.197742 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1408/2824] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:15.206599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.206889 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.207166 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.224768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:15.225982 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:15.234482 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1417/2825] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:15.238795 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.248108 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f59e-795f-46b9-a81e-b76fc6501f07 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.253803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.254440 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.254716 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.254985 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.255694 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:05:15.255995 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.257562 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.269478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1409/2826] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:05:15.273503 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.283288 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed804-acaf-4c2b-93b9-3a572f4f95b0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.287964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.288599 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.288876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.289147 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.289869 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.291730 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.318089 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1418/2827] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:05:15 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:05:15.322350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.332584 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abccb-2f1f-4c96-aa7c-40ce88decd69 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.386628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.387278 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.387560 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.387834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.388531 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.390473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.410193 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1410/2828] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:05:15 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:05:15.414341 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.424812 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2c11-bd88-4453-aa2a-dd327ece57bb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.429592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.430281 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.430583 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.430857 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.431554 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.433168 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.444113 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1419/2829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:05:15.448222 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.458540 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a472-760f-4c18-8667-f010097025f9 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.463089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.463725 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.464019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.464268 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.464970 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.466572 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b5d9-59fb-409d-85ba-958186c65b99 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.479297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1411/2830] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:05:15.483988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.493694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4d9b-48ea-4f35-8a9b-41fc366b201f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.498808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.499682 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.499961 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.500230 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] PATH_INFO: `/v3/projects/f1aefde2f00e4ffba2614ce672b38cba/users/722845d3396a4b7583522023036afc12/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.514594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1aefde2f00e4ffba2614ce672b38cba, user_id=722845d3396a4b7583522023036afc12, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.517215 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.529969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1420/2831] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:05:15 2022] PUT /identity/v3/projects/f1aefde2f00e4ffba2614ce672b38cba/users/722845d3396a4b7583522023036afc12/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:15.539962 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.540295 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.540592 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.566293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] MFA Rules not processed for user `722845d3396a4b7583522023036afc12`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:15.567474 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:15.628844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1412/2832] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:15.641140 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:15.642994 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:15.698180 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cff39-909d-4563-8dbc-41c2c7ba311a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:15.701881 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986749ece20e480fb60caaea17d97655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:15.702449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:15.702725 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:15.703001 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:15.710934 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:15.712342 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61a23b-7007-4d39-8121-51af1aa20d57 service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:15.721088 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1421/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:40.130305 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:40.192707 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722106f-ecfe-4a49-b1b0-983f8f5a0dfb None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:40.197202 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:40.198083 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.198366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.198642 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] PATH_INFO: `/v3/users/722845d3396a4b7583522023036afc12` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.199818 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=722845d3396a4b7583522023036afc12)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:40.201745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:40.245812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722845d3396a4b7583522023036afc12'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.246450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722845d3396a4b7583522023036afc12'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.247044 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722845d3396a4b7583522023036afc12'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.258915 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722845d3396a4b7583522023036afc12'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.266664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722845d3396a4b7583522023036afc12'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.278126 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1413/2834] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:05:40 2022] DELETE /identity/v3/users/722845d3396a4b7583522023036afc12 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:40.282671 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.283171 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.283280 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.300077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:40.301255 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:40.359806 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1422/2835] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:40.369366 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:40.370823 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:40.425871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb363-9734-43aa-b699-983946c57c8a admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:40.429613 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:40.430683 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.430812 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.431061 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.440860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:40.442321 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21549bb5-55e7-485f-b015-9fa5f1983bcd service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:40.451576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1414/2836] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:40.709624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:40.711163 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:40.723752 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b201fbc-caee-4f93-abb9-885a8076c02a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:40.728283 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:40.729138 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.729417 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.729764 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] PATH_INFO: `/v3/projects/f1aefde2f00e4ffba2614ce672b38cba` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.730914 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1aefde2f00e4ffba2614ce672b38cba)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:40.732868 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:40.777462 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1aefde2f00e4ffba2614ce672b38cba', 'request_id': 'req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.782968 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1aefde2f00e4ffba2614ce672b38cba', 'request_id': 'req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.788838 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1aefde2f00e4ffba2614ce672b38cba', 'request_id': 'req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.800349 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] The token cache is being invalidate because project f1aefde2f00e4ffba2614ce672b38cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:05:40.800634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.801246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8a4602fe-221c-4b0a-8cb5-14d5e20f1257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:05:40.802808 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1423/2837] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:05:40 2022] DELETE /identity/v3/projects/f1aefde2f00e4ffba2614ce672b38cba => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:40.807702 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.807994 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.808273 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.826251 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:40.828049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:40.885002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1415/2838] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:05:40.893697 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.894056 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.894338 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.912143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:40.913435 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:40.921736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1424/2839] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:40.925860 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:40.935336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a31eea-afa7-44da-9c00-ab4e5f1604b5 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:40.941542 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:40.942221 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.942502 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.942776 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.943497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:05:40.943803 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:40.945373 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:40.957365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1416/2840] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:05:40.961536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:40.970634 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862d37-7102-4f65-9f96-94ad6f79ac33 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:40.975246 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:40.975890 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:40.976172 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:40.976448 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:40.977137 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:40.979092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.003692 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1425/2841] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:05:40 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:05:41.007739 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:41.018336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3d9c-f393-4993-864e-719ae77cf9c3 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:41.073095 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:41.073775 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.074060 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.074336 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.075017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:41.076907 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.096451 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1417/2842] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:05:41 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:05:41.100536 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:41.110588 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f121427-df82-4f77-8651-c44b6f68de38 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:41.115152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:41.115798 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.116077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.116352 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.117083 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:41.118681 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.129289 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1426/2843] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:05:41.134763 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:41.145265 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30313-aa59-4360-83dc-72d0a0da0957 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:41.149831 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:41.150472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.150751 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.151021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.151730 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:41.153291 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd624-6acc-4464-a5eb-cff72317629d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.163043 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1418/2844] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:05:41.167016 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:41.177191 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d80ec3-d56a-427f-b2ff-69b15c88ec9b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:41.181726 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:41.182581 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.182856 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.183124 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] PATH_INFO: `/v3/projects/444d2e30e52f4c2d8c7f849b61c0a16a/users/142fe1dfec18477380a7ae3920d27243/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.198109 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444d2e30e52f4c2d8c7f849b61c0a16a, user_id=142fe1dfec18477380a7ae3920d27243, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:41.200768 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.213624 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1427/2845] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:05:41 2022] PUT /identity/v3/projects/444d2e30e52f4c2d8c7f849b61c0a16a/users/142fe1dfec18477380a7ae3920d27243/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:05:41.218672 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dd4-19e6-48f3-8053-9793243460de None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.218959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dd4-19e6-48f3-8053-9793243460de None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.219231 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dd4-19e6-48f3-8053-9793243460de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.236938 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-4f1a3dd4-19e6-48f3-8053-9793243460de None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:41.238190 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-4f1a3dd4-19e6-48f3-8053-9793243460de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:41.294956 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1419/2846] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:41.304875 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:41.306616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:41.362204 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eab89-d65c-4abd-88cd-22806b34dbd7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:41.365826 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:41.366463 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:41.366743 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:41.367015 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:41.376592 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:41.378052 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:41.387232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1428/2847] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:42.217215 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7614ee-dfd5-444a-8902-dd0b20dc2d7c None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:42.217734 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7614ee-dfd5-444a-8902-dd0b20dc2d7c None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:42.217875 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7614ee-dfd5-444a-8902-dd0b20dc2d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:42.244459 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ec7614ee-dfd5-444a-8902-dd0b20dc2d7c None None] MFA Rules not processed for user `142fe1dfec18477380a7ae3920d27243`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:42.245844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ec7614ee-dfd5-444a-8902-dd0b20dc2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:42.308847 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1420/2848] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:05:42.320426 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:05:42.321884 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:42.378351 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfeea0-cb7d-4fd7-8272-f87a8b309da1 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:05:42.381825 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:05:42.382471 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:42.382748 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:42.383023 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:42.392364 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:05:42.393781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:05:42.402632 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1429/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:05:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:05:43.739056 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9902ea-046d-4584-a245-8f84c1563ff1 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:05:43.739583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9902ea-046d-4584-a245-8f84c1563ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:05:43.739583 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9902ea-046d-4584-a245-8f84c1563ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:05:43.758232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-0f9902ea-046d-4584-a245-8f84c1563ff1 None None] MFA Rules not processed for user `142fe1dfec18477380a7ae3920d27243`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:05:43.759404 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-0f9902ea-046d-4584-a245-8f84c1563ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:05:43.766777 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1421/2850] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:06:30.997134 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:06:30.998617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:06:31.010451 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee446c-b505-49f1-b021-bf9e67eb24f9 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:06:31.014055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:06:31.014689 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:06:31.014969 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:06:31.015240 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:06:31.016972 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:06:31.084653 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:06:31.086019 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:06:31.097494 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1430/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:06:41.029472 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:06:41.030009 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:06:41.030204 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:06:41.048345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] MFA Rules not processed for user `142fe1dfec18477380a7ae3920d27243`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:06:41.049510 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:06:41.056489 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1422/2852] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:06:41.591848 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:06:41.600833 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc1477-c609-4d4f-849e-9772b35e066b service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:06:41.604408 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:06:41.605057 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:06:41.605316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:06:41.605587 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:06:41.607863 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:06:41.622118 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:06:41.623489 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:06:41.635772 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1431/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:07:33.777194 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:33.788252 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b08ea5-7387-4e08-b44a-a69728befbc2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:33.793288 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:33.794320 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:33.794478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:33.794745 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] PATH_INFO: `/v3/users/142fe1dfec18477380a7ae3920d27243` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:33.795965 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142fe1dfec18477380a7ae3920d27243)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:33.798688 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:33.846079 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142fe1dfec18477380a7ae3920d27243'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:33.846651 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142fe1dfec18477380a7ae3920d27243'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:33.847256 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142fe1dfec18477380a7ae3920d27243'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:33.858990 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142fe1dfec18477380a7ae3920d27243'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:33.866503 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-579e41a7-facf-4656-a4ee-e7c3d063e356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142fe1dfec18477380a7ae3920d27243'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:33.878331 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1423/2854] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:07:33 2022] DELETE /identity/v3/users/142fe1dfec18477380a7ae3920d27243 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:07:34.046567 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.057575 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe8e2-3b89-4596-ba8a-c59da6f0dc0b service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.113247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.114063 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.114343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.114616 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] PATH_INFO: `/v3/projects/444d2e30e52f4c2d8c7f849b61c0a16a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.115781 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=444d2e30e52f4c2d8c7f849b61c0a16a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.118212 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.162406 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444d2e30e52f4c2d8c7f849b61c0a16a', 'request_id': 'req-6167e87b-95aa-4835-aceb-ac905f7ada6f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:34.167574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444d2e30e52f4c2d8c7f849b61c0a16a', 'request_id': 'req-6167e87b-95aa-4835-aceb-ac905f7ada6f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:34.173470 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444d2e30e52f4c2d8c7f849b61c0a16a', 'request_id': 'req-6167e87b-95aa-4835-aceb-ac905f7ada6f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:34.185850 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] The token cache is being invalidate because project 444d2e30e52f4c2d8c7f849b61c0a16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:07:34.186135 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:34.186761 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6167e87b-95aa-4835-aceb-ac905f7ada6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:07:34.188278 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1432/2855] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:07:34 2022] DELETE /identity/v3/projects/444d2e30e52f4c2d8c7f849b61c0a16a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:07:34.195300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.195597 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.195892 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.212772 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:07:34.214049 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:34.272187 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1424/2856] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:07:34.280541 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.280835 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.281144 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.298966 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:07:34.300159 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:34.308267 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1433/2857] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:07:34.312306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.322596 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce59d-e1e6-46e8-acde-045d9fba99e2 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.327128 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.327768 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.328057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.328327 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.329041 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79832) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:07:34.329342 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.330959 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.342850 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1425/2858] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 5 15:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:07:34.346930 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.356122 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70b259-0a94-499f-8568-d8aed40be1a6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.360655 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.361291 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.361571 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.361879 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.362563 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.364525 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.389009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1434/2859] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:07:34 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:07:34.392952 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.403297 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e2b2-4ff7-4ef3-a814-24433fb74a37 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.459504 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.461250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.461533 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.461844 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.462527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.464422 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.483900 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1426/2860] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:07:34 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:07:34.488059 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.498105 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b787d-02d8-4a44-9669-5804cf05d2b6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.502694 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.503343 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.503625 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.503902 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.504620 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.506249 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.517066 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1435/2861] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:07:34.520834 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.531082 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07756-e00b-4d2c-875f-4f6285c5ab49 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.535655 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.536299 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.536581 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.536858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.537568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.539675 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d642600-968d-49c0-a8eb-505f9545d783 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.549249 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1427/2862] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:07:34.553247 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.564262 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e953-db1b-4da5-b776-e4d8a13b4741 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.569050 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.570188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.570465 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.570766 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] PATH_INFO: `/v3/projects/96dff8e44df34088aeec63a217d030bc/users/5cd45b1ef793416ea3adb7376676c031/roles/c51ca2684cd043fdb1ef8d5ca4e046bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.586603 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dff8e44df34088aeec63a217d030bc, user_id=5cd45b1ef793416ea3adb7376676c031, role_id=c51ca2684cd043fdb1ef8d5ca4e046bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.589357 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.603103 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1436/2863] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:07:34 2022] PUT /identity/v3/projects/96dff8e44df34088aeec63a217d030bc/users/5cd45b1ef793416ea3adb7376676c031/roles/c51ca2684cd043fdb1ef8d5ca4e046bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:07:34.608177 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc3a7a-27fc-4450-ac8d-40e66c479a87 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.608473 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc3a7a-27fc-4450-ac8d-40e66c479a87 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.608754 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc3a7a-27fc-4450-ac8d-40e66c479a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.626389 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-ecbc3a7a-27fc-4450-ac8d-40e66c479a87 None None] MFA Rules not processed for user `9ab29a96b7f245e482c4b00b767803a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:07:34.627497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ecbc3a7a-27fc-4450-ac8d-40e66c479a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:34.684465 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1428/2864] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:07:34.694484 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:34.696347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:34.750897 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778d8a-869d-4da4-8116-71b3ae6b78d6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:34.754530 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:34.755162 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:34.755440 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:34.755712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:34.764794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:34.766232 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:34.776194 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1437/2865] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:07:38.724566 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:38.725106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:38.725250 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:38.752885 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.auth.core [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] MFA Rules not processed for user `5cd45b1ef793416ea3adb7376676c031`. Rule list: `[]` (Enabled: `True`). {{(pid=79832) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:07:38.754141 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:38.816340 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1429/2866] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:07:38.821211 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:38.830736 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14f17c-f6fb-4bdd-9344-5d89c542753f service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:38.836033 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:38.836794 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:38.837142 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:38.837582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:38.838441 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:38.840415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:38.869566 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1438/2867] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 5 15:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:07:38.874002 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:38.886017 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8704f-4e70-409f-89c9-00e385d63149 None None] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:38.953348 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:38.954232 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] REQUEST_METHOD: `POST` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:38.954515 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:38.954785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] PATH_INFO: `/v3/users` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:38.958365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:38.958365 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:38.981151 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1430/2868] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 5 15:07:38 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:07:38.984909 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:38.997310 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c31a-4198-455d-98b6-126ef1731649 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:39.002227 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:39.003316 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:39.003700 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:39.004077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:39.004908 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:39.007006 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:39.024449 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1439/2869] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:07:39.025832 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:39.036430 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1fbb8-a28d-4d24-929b-386e1cb0f36d admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:39.042225 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:39.043123 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:39.043407 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:39.043732 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] PATH_INFO: `/v3/projects/73f37f88f4ee41839ebc58d83b14208e/users/6af3f77fb2cd4272b69d74eca9cbf193/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:39.060293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f37f88f4ee41839ebc58d83b14208e, user_id=6af3f77fb2cd4272b69d74eca9cbf193, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:39.063641 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:39.079646 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1431/2870] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:07:39 2022] PUT /identity/v3/projects/73f37f88f4ee41839ebc58d83b14208e/users/6af3f77fb2cd4272b69d74eca9cbf193/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:07:39.083176 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:39.094733 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414c9f-b77c-49f2-9164-9dd6c55357f2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:39.165723 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:39.166399 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:39.166680 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:39.166955 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:39.167679 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:39.169258 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2e25d-13d7-43a4-93ab-63e862d19529 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:39.178950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1440/2871] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 5 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:07:39.185595 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:39.199789 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b63bb-5e35-4e36-8145-bf67275fa59f admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:39.204721 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:39.205820 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] REQUEST_METHOD: `PUT` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:39.206105 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:39.206376 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] PATH_INFO: `/v3/projects/73f37f88f4ee41839ebc58d83b14208e/users/6af3f77fb2cd4272b69d74eca9cbf193/roles/bff88c5c7fe34509acfa67ec769df632` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:39.208454 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f37f88f4ee41839ebc58d83b14208e, user_id=6af3f77fb2cd4272b69d74eca9cbf193, role_id=bff88c5c7fe34509acfa67ec769df632)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:39.211706 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:39.223450 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1432/2872] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 5 15:07:39 2022] PUT /identity/v3/projects/73f37f88f4ee41839ebc58d83b14208e/users/6af3f77fb2cd4272b69d74eca9cbf193/roles/bff88c5c7fe34509acfa67ec769df632 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:07:43.885174 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e844f5-01bc-425a-9c9d-8955f1999ac0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:43.886035 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e844f5-01bc-425a-9c9d-8955f1999ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:43.886318 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e844f5-01bc-425a-9c9d-8955f1999ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:43.913950 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f4e844f5-01bc-425a-9c9d-8955f1999ac0 None None] MFA Rules not processed for user `6af3f77fb2cd4272b69d74eca9cbf193`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:07:43.915582 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f4e844f5-01bc-425a-9c9d-8955f1999ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:43.984077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1441/2873] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:07:43.996306 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:07:43.998073 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:07:44.083171 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef5677-c419-4afd-9c2c-a56e7f45177c admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:07:44.088867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:07:44.089524 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:07:44.089836 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:07:44.090112 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:07:44.151438 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:07:44.153024 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:07:44.162212 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1433/2874] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:00.533025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:00.533635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:00.533635 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:00.552188 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] MFA Rules not processed for user `5cd45b1ef793416ea3adb7376676c031`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:08:00.553390 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:00.560415 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1442/2875] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:08:00.918608 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:00.920420 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:00.980076 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b130-78c8-451f-84f8-9ef72d6db590 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:00.983628 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:00.984263 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:00.984544 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:00.984819 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:00.986576 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:00.996521 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:00.998132 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:01.006018 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1434/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:02.480055 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:02.482370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:02.567418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482cf1c-ddc1-448c-95f6-12c82c99ad3e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:02.572782 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:02.573416 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:02.573717 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:02.573988 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:02.575732 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:02.587645 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:02.589214 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:02.598876 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1443/2877] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:04.260911 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:04.269871 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968f45-41f6-403a-b6f4-5473719faf1f service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:04.274345 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:04.274999 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:04.275280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:04.275551 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:04.277478 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:04.288167 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:04.289773 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:04.298396 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1435/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:04.927053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:04.930132 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:04.949155 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced872-b812-4be2-9a02-845fd30a606e service placement] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:04.959041 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:04.959807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:04.960098 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:04.960371 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:04.962453 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:04.977143 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:04.978949 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:04.992708 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1444/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:13.657867 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:13.672435 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc791c2-1278-448b-b433-2e44c6a7d4f3 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:13.677848 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:13.678480 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:13.678756 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:13.679026 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:13.681950 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:13.694720 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:13.697243 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:13.707864 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1436/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:08:15.493580 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:15.502829 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510085b-df2e-48d1-8203-cc4ab009c53b service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:15.506395 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:15.507051 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:15.507329 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:15.507601 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:15.517092 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:15.518545 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba463519-ef39-4c75-8acb-0259c5440089 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:15.528576 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1445/2881] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:10:16.617406 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.675344 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455a8b-b72f-4796-8fca-e36ce74a34e0 service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.680568 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.681216 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.681497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.681806 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.684209 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:16.717910 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.719493 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.730191 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1437/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:10:18.237502 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d77f4-e7ba-46fe-8d7c-83823fdacb7d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.238060 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d77f4-e7ba-46fe-8d7c-83823fdacb7d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.238169 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d77f4-e7ba-46fe-8d7c-83823fdacb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.255253 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c9d77f4-e7ba-46fe-8d7c-83823fdacb7d None None] MFA Rules not processed for user `5cd45b1ef793416ea3adb7376676c031`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:18.256444 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c9d77f4-e7ba-46fe-8d7c-83823fdacb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:18.263919 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1446/2883] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:10:35.023785 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.052719 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f9ac-f3c8-4fc0-bf98-dfa17ef8b0d8 service placement] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.058358 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f119b3cd5647b39942bdc91f95d8df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.059021 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.059392 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.059673 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.061452 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:35.086767 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.088307 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.099853 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1438/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:12:09.836313 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:09.836864 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:09.836964 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:09.853953 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] MFA Rules not processed for user `5cd45b1ef793416ea3adb7376676c031`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:09.855117 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:09.861738 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1447/2885] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 5 15:12:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:12:09.900908 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:09.902300 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:09.976600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880d14-ef90-4dbc-9bf4-7e13291f7f9c service nova] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:09.980861 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1bd23334ec406f81303f12c5672889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:09.981437 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:09.981757 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:09.982033 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:09.983770 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:09.997527 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:09.998974 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:10.009664 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1439/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:12:10.711260 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:10.731297 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05478925-0a8f-4ba6-ae85-88f37950945e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:10.735027 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:10.735665 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.735947 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.736223 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:10.738025 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:10.752126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:10.753553 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:10.765077 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1448/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:12:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:13:43.438697 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.448135 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7fff2-b2ec-43f5-8627-bfebaf3a7c0f service cinder] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.451841 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.452497 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.452779 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.453057 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.460140 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.461545 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.470815 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1440/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:13:58.244711 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:58.253853 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24bda-eff5-4c45-9e21-4c005390573c service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.257418 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.258093 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.258377 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.258654 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.267574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.269009 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.277786 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1449/2889] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:14:11.619084 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:11.627811 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163136-0fc8-4042-b7aa-abb4ac4c5229 service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:11.631455 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb6e25f80f1b42b092c1ae964b179f64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:11.632091 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] REQUEST_METHOD: `GET` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:11.632350 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:11.632622 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:11.702237 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:11.703663 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:11.722246 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1441/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:14:17.796663 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.809544 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed0a9-5eb8-4f6b-a112-b4b05c94c06a service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.815370 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.816379 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.816742 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.816921 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] PATH_INFO: `/v3/users/5cd45b1ef793416ea3adb7376676c031` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.818256 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd45b1ef793416ea3adb7376676c031)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.820712 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.869259 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd45b1ef793416ea3adb7376676c031'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:17.870405 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd45b1ef793416ea3adb7376676c031'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:17.871053 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd45b1ef793416ea3adb7376676c031'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:17.882867 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd45b1ef793416ea3adb7376676c031'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:17.891398 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd45b1ef793416ea3adb7376676c031'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:17.905474 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1450/2891] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:14:17 2022] DELETE /identity/v3/users/5cd45b1ef793416ea3adb7376676c031 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:18.073940 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.084293 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250024e-dd9e-4bc7-8b63-d125170a960e service neutron] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.145512 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.146383 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.146658 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.146927 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] PATH_INFO: `/v3/projects/96dff8e44df34088aeec63a217d030bc` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.148106 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dff8e44df34088aeec63a217d030bc)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.150030 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.195880 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dff8e44df34088aeec63a217d030bc', 'request_id': 'req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.201248 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dff8e44df34088aeec63a217d030bc', 'request_id': 'req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.207361 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dff8e44df34088aeec63a217d030bc', 'request_id': 'req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.233573 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] The token cache is being invalidate because project 96dff8e44df34088aeec63a217d030bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:14:18.233887 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.234511 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.236023 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1442/2892] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:14:18 2022] DELETE /identity/v3/projects/96dff8e44df34088aeec63a217d030bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:18.240152 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.241574 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:18.254870 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807efd-c8ac-4b8d-a9d7-81e830ddb03e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.311210 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.312070 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.312347 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.312617 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] PATH_INFO: `/v3/users/6af3f77fb2cd4272b69d74eca9cbf193` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.313807 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af3f77fb2cd4272b69d74eca9cbf193)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.315753 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.363004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af3f77fb2cd4272b69d74eca9cbf193'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.363647 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af3f77fb2cd4272b69d74eca9cbf193'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.364239 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af3f77fb2cd4272b69d74eca9cbf193'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.375565 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af3f77fb2cd4272b69d74eca9cbf193'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.382594 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af3f77fb2cd4272b69d74eca9cbf193'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.395429 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1451/2893] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 5 15:14:18 2022] DELETE /identity/v3/users/6af3f77fb2cd4272b69d74eca9cbf193 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:18.567585 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Authenticating user token {{(pid=79832) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.569039 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.fernet_utils [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79832) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:18.583233 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6d9b8-1c02-4a0c-8705-d414a655dcd2 admin admin] Validating token access rules against request {{(pid=79832) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.640432 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab29a96b7f245e482c4b00b767803a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dff5ce0253c84661be86a23d6b0b873d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79832) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.641280 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.641554 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] SCRIPT_NAME: `/identity` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.641858 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] PATH_INFO: `/v3/projects/73f37f88f4ee41839ebc58d83b14208e` {{(pid=79832) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.643019 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f37f88f4ee41839ebc58d83b14208e)` {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.644891 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] RBAC: Authorization granted {{(pid=79832) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.689600 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f37f88f4ee41839ebc58d83b14208e', 'request_id': 'req-a497aff6-6afe-4030-aaa2-ef30c1bb160e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.695089 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f37f88f4ee41839ebc58d83b14208e', 'request_id': 'req-a497aff6-6afe-4030-aaa2-ef30c1bb160e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.701550 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f37f88f4ee41839ebc58d83b14208e', 'request_id': 'req-a497aff6-6afe-4030-aaa2-ef30c1bb160e'} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.713051 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] The token cache is being invalidate because project 73f37f88f4ee41839ebc58d83b14208e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79832) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:14:18.713359 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.714080 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: DEBUG keystone.notifications [None req-a497aff6-6afe-4030-aaa2-ef30c1bb160e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79832) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:14:18.715604 dv-cinder-839426-6-iscsi devstack@keystone.service[79832]: [pid: 79832|app: 0|req: 1443/2894] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 5 15:14:18 2022] DELETE /identity/v3/projects/73f37f88f4ee41839ebc58d83b14208e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:15:44.114004 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:44.115481 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:44.187801 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8353a-723b-4289-b7eb-fd0ec8c9e77c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:44.245201 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738c11c19b03412d95720428d76d29b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de15899c587405f8801dbb34b698b6d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:44.246834 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:44.247111 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:44.247376 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:44.249126 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:44.260198 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:44.261931 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff97a-3cd4-4a78-8805-4d469cb4b731 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:44.271535 dv-cinder-839426-6-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1452/2895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 5 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)